Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 489.115813ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:17:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 489.144952ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 413.273555ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:17:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 414.026545ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 462.320822ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:17:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 462.374624ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 526.67785ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:17:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 526.766134ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 603.956077ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:17:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 603.9848ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 462.858097ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:16:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 462.917307ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 449.420793ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:16:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 449.578166ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 412.27276ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:16:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 412.302279ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 430.073702ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:15:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 430.1677ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 490.295283ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:15:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 490.33995ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 435.742608ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:15:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 435.766098ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 555.140432ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:15:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 555.170752ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 458.353557ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:15:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 458.375196ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 481.49757ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:14:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 481.530418ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 447.39575ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:14:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 447.498249ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 507.773247ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:14:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 507.803128ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 531.455079ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:14:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 531.494221ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 448.339969ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:13:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 448.372443ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 385.436233ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:13:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 385.465379ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 411.242536ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:13:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 411.282976ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 490.18401ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:12:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 490.216697ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 461.019335ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:12:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 461.113824ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 475.543246ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:12:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 475.573655ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 497.466132ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:12:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 497.497031ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 502.011155ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:11:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 502.122688ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 402.692606ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:11:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 402.722483ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 475.028955ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:11:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 475.064117ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 516.473812ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:11:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 516.521644ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 757.73159ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:10:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 757.767832ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 562.061754ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:10:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 562.086131ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 432.554444ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:10:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 432.888277ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 499.482048ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:10:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 499.589208ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 465.875509ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:09:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 465.904176ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 409.131136ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:09:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 409.157142ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 527.337917ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:09:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 527.38733ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 488.358326ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:09:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 488.38551ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 410.241057ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:09:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 410.268142ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 407.448284ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:08:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 407.465861ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 449.037804ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:08:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 449.083699ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 478.185802ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:08:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 478.214941ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 582.764788ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:08:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 582.795914ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 436.400301ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:07:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 436.437269ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 443.484447ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:07:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 443.614967ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 441.624711ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:07:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 441.655962ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 500.859033ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:07:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 500.889076ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 497.856211ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:06:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 497.886557ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 382.50329ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:06:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 382.535512ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 426.465721ms trace: https://jaeger.dev.storj.io/trace/6c4cbd1edfce8e6 FAIL (2026-01-31 09:06:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 426.503412ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 548.837635ms trace: https://jaeger.dev.storj.io/trace/62a1509ecc5b5058 FAIL (2026-01-31 09:06:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 31 08:42:01.166771110 (376h46m54.650228297s) [upload=391707]: Starting upload Jan 31 08:42:01.166986060 (376h46m54.650443258s) [upload=391707]: Done starting upload Jan 31 08:42:01.167072896 (376h46m54.650530094s) [upload=391707]: Uploading segments... Jan 31 08:42:01.167397789 (376h46m54.650854991s) [upload=391707]: Got next segment. Inline: false Jan 31 08:42:01.167473452 (376h46m54.650930657s) [upload=391707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.167480315 (376h46m54.650937524s) [upload=391707]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.195346764 (376h46m54.678803969s) [seg_pos={0 0}, upload=391707]: Begin upload segment... Jan 31 08:42:01.195428575 (376h46m54.678885757s) [seg_pos={0 0}, upload=391707]: Done begin upload segment. Jan 31 08:42:01.195463009 (376h46m54.678920214s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.195847779 (376h46m54.679304986s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197051385 (376h46m54.680508591s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.197594770 (376h46m54.681051978s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198049760 (376h46m54.681506963s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198528799 (376h46m54.681986007s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.198996489 (376h46m54.682453701s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199526016 (376h46m54.682983298s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.199772893 (376h46m54.683230102s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200006077 (376h46m54.683463277s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200298977 (376h46m54.68375618s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.200764860 (376h46m54.684222068s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201330795 (376h46m54.68478802s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.201862657 (376h46m54.685319865s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.202435299 (376h46m54.685892502s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.203149033 (376h46m54.686606237s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Uploading piece... Jan 31 08:42:01.288234960 (376h46m54.771692157s) [upload=391707]: Next returned nil segment Jan 31 08:42:01.288251604 (376h46m54.771708818s) [upload=391707]: Waiting for error group managing segments... Jan 31 08:42:01.293400797 (376h46m54.776858002s) [noise=true , address=77.90.31.19:4844 , piece_id=OOSM5KL3DLPGXCQ4UI7JIF7H3CZ2TNRN35FUXBD2N3F4D4DB44HQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294083673 (376h46m54.777540862s) [noise=true , address=77.90.31.14:4663 , piece_id=TSJWQMUOQXG62R2IX5XMS2X7QWK56DZXIAWSWLBFVXSSWZAW7CTQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.294285106 (376h46m54.777742305s) [noise=true , address=145.79.227.47:4265 , piece_id=Y7NQBPEPRYTHMGIXXFPLYVQ6OQCVAXMWJPRIVCSFAFSTCIRCLK7A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295108197 (376h46m54.778565394s) [noise=true , address=145.79.227.41:4087 , piece_id=YS5JMZLEXXL6O33YEZSZNH4R4W6QACS3XL5P3THSTNYNQPMJYBOA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295172272 (376h46m54.778629467s) [noise=true , address=145.79.227.35:4482 , piece_id=3KIO5DQKH5FKM22JG4JEOEFT45H3XHHNX6SVAB56NMQC43P4HJ7Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295900158 (376h46m54.779357349s) [noise=true , address=145.79.227.30:4761 , piece_id=WJDRFHX52HPXTRKWDTY7OBNOW7SDJTHWQHFOSVL7YYTGPBRZNHBQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.295955977 (376h46m54.779413173s) [noise=true , address=145.79.227.48:4302 , piece_id=MWXXVBXXQKZ5E5M4V5DC2S2KGL4ARRUREQERPH47PUPC6Z7SJW6A, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296392614 (376h46m54.779849814s) [noise=true , address=145.79.227.36:4517 , piece_id=6EUEWRVVKLSBBVLVY6S33D4QLDCYD455QP4GN3RGIA65CO7J5TVA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296441340 (376h46m54.779898537s) [noise=true , address=145.79.227.34:4906 , piece_id=E3MAVCWQIVD7Q5MOPAKAZ7FFYQ4LHLJHU5XUA3QMQTCQZ3CUWDYQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296874674 (376h46m54.780331861s) [noise=true , address=145.79.227.40:4049 , piece_id=TCQX7KJYEGI3NRLW3UWZNSRMEILBIHGN2ABW64TRMN6U7XMC36FQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.296909101 (376h46m54.780366298s) [noise=true , address=145.79.227.43:4158 , piece_id=SHVKLK6QZB7LM3H2EEUNDYC25NASIJAU7FENSP6JW7ZP56GG6EDQ, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:01.297409404 (376h46m54.780866604s) [noise=true , address=145.79.227.37:4566 , piece_id=MZG2PRH45I62HWBUQDKZHMDT4XE4BFOBW66TTXVEAA2W52CJYX4Q, seg_pos={0 0}, upload=391707]: Done uploading piece. err: <nil> Jan 31 08:42:31.121919846 (376h47m24.605377048s) [noise=true , address=45.91.116.7:4012 , piece_id=ALZYURAGTVTA4IZM24T53QUMMLALXAMO7O424EDM53BX3RNI33NA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: read tcp 159.223.143.39:60086->45.91.116.7:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122001831 (376h47m24.605459038s) [noise=true , address=45.91.116.5:4297 , piece_id=R4SR4HHRWNHXI7NGGI2VJRSTMXYQHOK7KC6CKECL3C2J5OMQC3RA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 159.223.143.39:60218->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122048345 (376h47m24.605505567s) [noise=true , address=45.91.116.10:4083 , piece_id=OKPB7UVIY3SCHHNV323ZTHZVY4GT4HUOINPDI5NUNMAMWG4NQAAA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 159.223.143.39:45254->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122106214 (376h47m24.605563415s) [noise=true , address=45.91.116.8:4070 , piece_id=QKO4TG426T3Z5IHURJXGRCYOXLARE66VETAEIJPJ4X6XC35WV4VA, seg_pos={0 0}, upload=391707]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: read tcp 159.223.143.39:50716->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.122131285 (376h47m24.605588469s) [seg_pos={0 0}, upload=391707]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 31 08:42:31.141063957 (376h47m24.624521154s) [upload=391707]: Done uploading segments... Jan 31 08:42:31.141101292 (376h47m24.624558493s) [upload=391707]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 548.887081ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 462.639351ms trace: https://jaeger.dev.storj.io/trace/33d822523a7c81ef FAIL (2026-01-31 09:05:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 462.749746ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)