Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...................XXX......................................] duration: 470.923982ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:11:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 471.764872ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 564.635206ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:11:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 564.671846ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....................XXX.....................................] duration: 706.786712ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:11:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 706.82328ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.228495828s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:10:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.228527731s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 644.106707ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:10:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 644.133329ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....................XXX....................................] duration: 605.571813ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:10:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 605.678376ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 958.141891ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:10:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 958.174939ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.699510659s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:09:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.699620739s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 652.43616ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:09:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 652.464389ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......................XXX...................................] duration: 552.149184ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:09:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 552.196027ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 579.010113ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:08:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 579.037749ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.......................XXX..................................] duration: 696.787024ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:08:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 696.819869ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.337377362s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.337402313s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........................XXX.................................] duration: 679.145138ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:08:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 679.175199ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 675.361765ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:07:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 676.075567ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........................XXX................................] duration: 718.50594ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:07:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 718.539494ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.181207926s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:07:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.181240929s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 623.195654ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:06:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 623.258286ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.296833895s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:06:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.296938668s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..........................XXX...............................] duration: 436.292392ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:06:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 436.363945ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.232047855s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:05:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.232081521s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...........................XXX..............................] duration: 630.267601ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:05:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 630.297136ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 664.99846ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:05:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 665.04045ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.147995989s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:05:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.148027558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 560.045489ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:05:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 560.101382ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [............................XXX.............................] duration: 596.792868ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:04:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 596.821887ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.264122584s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:04:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.264157337s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.312412662s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:04:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.312435608s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.............................XXX............................] duration: 753.077809ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:04:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 753.143322ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 642.253804ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:04:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 642.42997ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.218192828s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:03:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.218226977s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 655.228987ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:03:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 655.321556ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............................XXX...........................] duration: 501.417329ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:03:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 501.451555ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.361347457s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:03:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.361378582s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.211938406s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:02:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.212001949s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 594.561043ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:02:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 594.669297ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...............................XXX..........................] duration: 826.88654ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:02:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 826.9395ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 576.468448ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:01:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 576.878169ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [................................XXX.........................] duration: 505.018502ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:01:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 505.15583ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.255168498s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:01:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.255198819s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.................................XXX........................] duration: 487.816721ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:01:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 487.849522ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 574.73131ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:01:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 574.772085ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 793.048053ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:00:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 793.172887ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..................................XXX.......................] duration: 448.768239ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 16:00:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 448.797525ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 715.111794ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:00:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 715.15358ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.64260424s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 16:00:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.642708404s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 829.326269ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 16:00:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 829.418369ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 803.387909ms trace: https://jaeger.dev.storj.io/trace/4777dea64937dc1a FAIL (2026-04-06 15:59:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 803.488264ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.487253864s trace: https://jaeger.dev.storj.io/trace/449433b6185f502e FAIL (2026-04-06 15:59:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== Apr 6 15:40:03.627476193 (748h40m1.224247238s) [upload=838298]: Starting upload Apr 6 15:40:03.627555112 (748h40m1.224326149s) [upload=838298]: Done starting upload Apr 6 15:40:03.627971751 (748h40m1.224742775s) [upload=838298]: Uploading segments... Apr 6 15:40:03.628052062 (748h40m1.224823089s) [upload=838298]: Got next segment. Inline: false Apr 6 15:40:03.628101312 (748h40m1.224872344s) [upload=838298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 15:40:03.628108719 (748h40m1.224879786s) [upload=838298]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 15:40:03.657925511 (748h40m1.254696552s) [seg_pos={0 0}, upload=838298]: Begin upload segment... Apr 6 15:40:03.658006444 (748h40m1.254777507s) [seg_pos={0 0}, upload=838298]: Done begin upload segment. Apr 6 15:40:03.658049451 (748h40m1.254820484s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658127629 (748h40m1.254898659s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.658849378 (748h40m1.255620415s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.659549528 (748h40m1.256320563s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660187950 (748h40m1.256958976s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.660848819 (748h40m1.257619849s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.661744944 (748h40m1.25851598s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.662381990 (748h40m1.259153021s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.663016005 (748h40m1.25978704s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.665366739 (748h40m1.262137771s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.666327038 (748h40m1.263098052s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.667370344 (748h40m1.264141368s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.668228606 (748h40m1.264999623s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.670639310 (748h40m1.267410325s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.671832750 (748h40m1.268603781s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.672735177 (748h40m1.269506187s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.673761153 (748h40m1.270532166s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.674068775 (748h40m1.27083979s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Uploading piece... Apr 6 15:40:03.768526476 (748h40m1.365297491s) [upload=838298]: Next returned nil segment Apr 6 15:40:03.768546305 (748h40m1.365317356s) [upload=838298]: Waiting for error group managing segments... Apr 6 15:40:04.090183416 (748h40m1.686954485s) [noise=true , address=167.17.72.71:4797 , piece_id=SCBKHW7H7YFLYZZFVT6JSBT6XFUSKQYOW3VRN275AJ7MN4YI4AOA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111363426 (748h40m1.708134444s) [noise=true , address=167.17.72.69:4734 , piece_id=JPHKDBK4IEMSZRNHRSDTGMSDNP6VFJZM7FLVUZOBLPZEESBFYIOQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.111628225 (748h40m1.708399237s) [noise=true , address=167.17.72.70:4754 , piece_id=WTUQ433XRWNDGHLG7FXULE77N3EQZI3L2RAZGZX24TQJAAPM7WNQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.123286299 (748h40m1.720057314s) [noise=true , address=167.17.72.68:4644 , piece_id=2SUMWQO5FV3WABHHGVLOHKNHY6XTEWTBOK7H2ZO5NKB5TRBTHVTA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.305166549 (748h40m1.901937573s) [noise=true , address=193.149.164.68:4065 , piece_id=ZUBZPNKM3WD6EC22MBDC54N6PDBMXPR3IFNWUZBOXJPDBELHTCRQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.309277855 (748h40m1.906048873s) [noise=true , address=193.149.164.71:4287 , piece_id=SZ7LQNXTEHH74XPWRFSNGS6LIM44IF7HFABJJ74EKHCSM5TOX63Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.310384222 (748h40m1.90715524s) [noise=true , address=193.149.164.70:4134 , piece_id=ADFW67E4S7IGQQ6GNB7R7JU43YVLSTEOOBXF5WGIN64OLBYI6S7A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.311558249 (748h40m1.908329268s) [noise=true , address=64.49.13.170:4723 , piece_id=VZG4UM2B4YUC7NYFCITOADGLWDBPEYGHJUHUCG5TTMW2OXNGDZ3Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.318896832 (748h40m1.915667854s) [noise=true , address=193.149.164.69:4073 , piece_id=X6LKMM4OEB36MKVK62Z2SU2FQ6QMMOZNO7V6AW23CSEX6QWWPL2A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.319687548 (748h40m1.916458575s) [noise=true , address=64.49.13.139:4471 , piece_id=7XPAYWANYD2ULF6VKQ62CDFV4R3GWZSLO3PXBU3OHIMTERSVGJ6Q, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.320573940 (748h40m1.917344962s) [noise=true , address=193.149.164.67:4003 , piece_id=BYZKHKH5VCAXFXQAKFUNQ5AUPXXGMOR4S6N46ZYCEWDTHXLIB2RA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.694686967 (748h40m2.291457994s) [noise=true , address=145.79.227.30:4773 , piece_id=EWG62WQ5HGNTKWAQUDO2JMXPLMGCVOINHNB32LKQG4FZZRYHWG4A, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:40:04.695909952 (748h40m2.292680979s) [noise=true , address=145.79.227.34:4911 , piece_id=3XYN5FDW46S63WCK72XALIRL5OXIJQ24WPPD6IZLE53XDPKN2PEQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: <nil> Apr 6 15:41:03.579925561 (748h41m1.176696593s) [noise=true , address=45.91.116.13:4181 , piece_id=IKW65PKAUL2VH4NAK75PROH3UVR3S2WXX4U66JJKCEM3AYMEB4SA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1h7LXGgUieZvwdvxcRGCLGSQVVV2PjFuEaze7ccG1hJLNB2aQ, address:45.91.116.13:4181): protocol: rpc: dial tcp 45.91.116.13:4181: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580475482 (748h41m1.177246511s) [noise=true , address=45.91.116.5:4331 , piece_id=MWV7QE3D7YQYLH6JXFB3FPLZ7JDCQ4QFJJTQD3V4RRBZCZSAVNIA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: write tcp 159.223.143.39:55764->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.580772045 (748h41m1.177543071s) [noise=true , address=45.91.116.7:4025 , piece_id=VCTH56NPYPTY6SWJMBS3IKUOBA5J7NJYN7YXNVNFXBHVZVYE77LQ, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1WnhUZYDuxiqz9Uji8mhnnHng724Qk9UEJEXyuHLEhbfJymMZj, address:45.91.116.7:4025): protocol: read tcp 159.223.143.39:33530->45.91.116.7:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581261292 (748h41m1.178032318s) [noise=true , address=45.91.116.6:4000 , piece_id=XP2BZQO5FXULIPVB4QJWKZUVA2MZVWJ3GCUIR6YQDI5S2VVAMQVA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:12CuCqHJYbanbuaEMHvtcuQXhvcdahD8eyT2fKDhqtxdSZ6ES4f, address:45.91.116.6:4000): protocol: write tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; close tcp 159.223.143.39:48362->45.91.116.6:4000: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 15:41:03.581606038 (748h41m1.178377062s) [noise=true , address=45.91.116.14:4197 , piece_id=LF6Z376GEE7C6IBOUIITPI4GTANECFOUL4RZ2GMBS4XVVQDRWJGA, seg_pos={0 0}, upload=838298]: Done uploading piece. err: ecclient: upload failed (node:1aarPYLumhCAtisqFVYu9iFnZqBHRFMFN2xakzn48kapVp2ae5, address:45.91.116.14:4197): protocol: context deadline exceeded; context deadline exceeded Apr 6 15:41:03.581732624 (748h41m1.178503641s) [seg_pos={0 0}, upload=838298]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 15:41:03.605380574 (748h41m1.202151599s) [upload=838298]: Done uploading segments... Apr 6 15:41:03.605444334 (748h41m1.20221536s) [upload=838298]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.487283615s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...................................XXX......................] duration: 568.842646ms trace: https://jaeger.dev.storj.io/trace/28874b4e710a2bcf FAIL (2026-04-06 15:59:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 568.866965ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)