Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 378.305215ms FAIL (2025-07-28 00:14:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== rue , address=104.36.82.6:4873 , piece_id=KLIOIPDMSH43MPPYETZKI76CHTZZYKHSLXQHZ4BUMTAIHB2UDUFA, seg_pos={0 0}, upload=25145]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3): protocol: rpc: dial tcp 104.36.82.6:4873: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:19.224827526 (26h20m35.005760889s) [seg_pos={0 0}, upload=25145]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:12:19.224911362 (26h20m35.005844727s) [upload=25145]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:12:19.224918336 (26h20m35.005851717s) [upload=25145]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:12:19.362327161 (26h20m35.143260528s) [upload=25145]: Done uploading segments... Jul 28 00:12:19.362346149 (26h20m35.143279514s) [upload=25145]: Upload finished. err: <nil> Jul 28 00:12:51.446334860 (26h21m7.227268227s) [upload=25149]: Starting upload Jul 28 00:12:51.446464358 (26h21m7.22739772s) [upload=25149]: Done starting upload Jul 28 00:12:51.446704322 (26h21m7.227637707s) [upload=25149]: Uploading segments... Jul 28 00:12:51.446787742 (26h21m7.227721116s) [upload=25149]: Got next segment. Inline: false Jul 28 00:12:51.446833329 (26h21m7.227766709s) [upload=25149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:12:51.446840824 (26h21m7.227774219s) [upload=25149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:12:51.485529866 (26h21m7.26646325s) [seg_pos={0 0}, upload=25149]: Begin upload segment... Jul 28 00:12:51.485678448 (26h21m7.266611834s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486282709 (26h21m7.267216075s) [seg_pos={0 0}, upload=25149]: Done begin upload segment. Jul 28 00:12:51.486329800 (26h21m7.267263182s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486415444 (26h21m7.267348831s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486711407 (26h21m7.267644781s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487045013 (26h21m7.267978389s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487052683 (26h21m7.267986065s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487333539 (26h21m7.268266915s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487624449 (26h21m7.268557836s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487637388 (26h21m7.268570764s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487963294 (26h21m7.268896672s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488384188 (26h21m7.269317573s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488402235 (26h21m7.269335622s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488790390 (26h21m7.269723765s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488981948 (26h21m7.269915335s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489139202 (26h21m7.270072587s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489529535 (26h21m7.270462922s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.590540290 (26h21m7.371473675s) [upload=25149]: Next returned nil segment Jul 28 00:12:51.590561833 (26h21m7.371495207s) [upload=25149]: Waiting for error group managing segments... Jul 28 00:12:51.593971573 (26h21m7.374904937s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594092106 (26h21m7.375025476s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594518922 (26h21m7.375452292s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596497721 (26h21m7.377431102s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596767382 (26h21m7.377700774s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597122347 (26h21m7.378055738s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597394157 (26h21m7.378327548s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597631346 (26h21m7.378564711s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597978444 (26h21m7.378911823s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598114353 (26h21m7.379047716s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598550692 (26h21m7.379484054s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598693441 (26h21m7.37962682s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:13:21.415422049 (26h21m37.196355417s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: write tcp 159.223.143.39:39116->104.36.82.2:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415498914 (26h21m37.19643229s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: rpc: dial tcp 104.36.82.16:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415564035 (26h21m37.196497411s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415610198 (26h21m37.196543564s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: write tcp 159.223.143.39:58476->104.36.82.4:4804: use of closed network connection; conn closed: op Jul 28 00:13:21.415628115 (26h21m37.19656148s) [seg_pos={0 0}, upload=25149]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:13:21.442171782 (26h21m37.22310515s) [upload=25149]: Done uploading segments... Jul 28 00:13:21.442216456 (26h21m37.223149832s) [upload=25149]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 378.335918ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 388.290616ms FAIL (2025-07-28 00:14:37 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 11) Duration: 388.357713ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 437.450553ms FAIL (2025-07-28 00:14:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== rue , address=104.36.82.6:4873 , piece_id=KLIOIPDMSH43MPPYETZKI76CHTZZYKHSLXQHZ4BUMTAIHB2UDUFA, seg_pos={0 0}, upload=25145]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3): protocol: rpc: dial tcp 104.36.82.6:4873: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:19.224827526 (26h20m35.005760889s) [seg_pos={0 0}, upload=25145]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:12:19.224911362 (26h20m35.005844727s) [upload=25145]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:12:19.224918336 (26h20m35.005851717s) [upload=25145]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:12:19.362327161 (26h20m35.143260528s) [upload=25145]: Done uploading segments... Jul 28 00:12:19.362346149 (26h20m35.143279514s) [upload=25145]: Upload finished. err: <nil> Jul 28 00:12:51.446334860 (26h21m7.227268227s) [upload=25149]: Starting upload Jul 28 00:12:51.446464358 (26h21m7.22739772s) [upload=25149]: Done starting upload Jul 28 00:12:51.446704322 (26h21m7.227637707s) [upload=25149]: Uploading segments... Jul 28 00:12:51.446787742 (26h21m7.227721116s) [upload=25149]: Got next segment. Inline: false Jul 28 00:12:51.446833329 (26h21m7.227766709s) [upload=25149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:12:51.446840824 (26h21m7.227774219s) [upload=25149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:12:51.485529866 (26h21m7.26646325s) [seg_pos={0 0}, upload=25149]: Begin upload segment... Jul 28 00:12:51.485678448 (26h21m7.266611834s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486282709 (26h21m7.267216075s) [seg_pos={0 0}, upload=25149]: Done begin upload segment. Jul 28 00:12:51.486329800 (26h21m7.267263182s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486415444 (26h21m7.267348831s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486711407 (26h21m7.267644781s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487045013 (26h21m7.267978389s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487052683 (26h21m7.267986065s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487333539 (26h21m7.268266915s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487624449 (26h21m7.268557836s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487637388 (26h21m7.268570764s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487963294 (26h21m7.268896672s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488384188 (26h21m7.269317573s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488402235 (26h21m7.269335622s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488790390 (26h21m7.269723765s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488981948 (26h21m7.269915335s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489139202 (26h21m7.270072587s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489529535 (26h21m7.270462922s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.590540290 (26h21m7.371473675s) [upload=25149]: Next returned nil segment Jul 28 00:12:51.590561833 (26h21m7.371495207s) [upload=25149]: Waiting for error group managing segments... Jul 28 00:12:51.593971573 (26h21m7.374904937s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594092106 (26h21m7.375025476s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594518922 (26h21m7.375452292s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596497721 (26h21m7.377431102s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596767382 (26h21m7.377700774s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597122347 (26h21m7.378055738s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597394157 (26h21m7.378327548s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597631346 (26h21m7.378564711s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597978444 (26h21m7.378911823s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598114353 (26h21m7.379047716s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598550692 (26h21m7.379484054s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598693441 (26h21m7.37962682s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:13:21.415422049 (26h21m37.196355417s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: write tcp 159.223.143.39:39116->104.36.82.2:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415498914 (26h21m37.19643229s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: rpc: dial tcp 104.36.82.16:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415564035 (26h21m37.196497411s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415610198 (26h21m37.196543564s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: write tcp 159.223.143.39:58476->104.36.82.4:4804: use of closed network connection; conn closed: op Jul 28 00:13:21.415628115 (26h21m37.19656148s) [seg_pos={0 0}, upload=25149]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:13:21.442171782 (26h21m37.22310515s) [upload=25149]: Done uploading segments... Jul 28 00:13:21.442216456 (26h21m37.223149832s) [upload=25149]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 437.481769ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 227.924102ms FAIL (2025-07-28 00:14:14 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 227.955251ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..................................................XXX.XXXXXX] duration: 1m0.036397337s FAIL (2025-07-28 00:14:12 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== .36.82.12:4174 , piece_id=MUBJTG2N5Q7CITTYLK6PBKK34QE7PKSRLCE544T23FNV6A4LJEPQ, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.981704249 (26h21m28.76263763s) [noise=true , address=104.36.82.6:4901 , piece_id=OI5GF6QFN7WOH52NWYJCZECLY5QDYFD5JGXOGRJMEXCEQVGQURBQ, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.982024129 (26h21m28.762957507s) [noise=true , address=104.36.82.15:4279 , piece_id=PVYGX4X3QUGD3D6TD2NXENMLKHRQO5QTKXEAPN4CH4OWV3EXEFYQ, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.982367533 (26h21m28.763300914s) [noise=true , address=104.36.82.16:4316 , piece_id=RXGU7UI3BQE4VL2TQAYEUZUB6QCJ2JG6ALIIJAFKJFI74EAWKEHA, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.982715686 (26h21m28.763649065s) [noise=true , address=104.36.82.14:4241 , piece_id=DLCOMMAKIULBHDCXOT75YUO5PAOJFRZW4UCGPHWQ5DW2CXEB2LLA, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.982997054 (26h21m28.763930433s) [noise=true , address=104.36.82.53:4156 , piece_id=TYYK7PPV2HXY3XIIEYB355AR5TS7ETLUWDUU3JNS66G32NPR64BQ, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.983369414 (26h21m28.764302805s) [noise=true , address=104.36.82.54:4165 , piece_id=FBXBURTZVPMXJE63UPPDDP6YPBDKOJCCSDWDR5U7AB4WVWUJDHJA, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.983732452 (26h21m28.76466583s) [noise=true , address=104.36.82.42:4814 , piece_id=GYTSXV42APDBOAUGUBHLSYO5H57KAOLXE3QL7UXH4LCNDSGITSUA, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.984085942 (26h21m28.76501932s) [noise=true , address=79.127.201.214:4291 , piece_id=WSWGLWB3QCDN7LVAYQ4PMHNXAIRNQUN2EC27MMH72AXF3ZOTLYUQ, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:12.984485560 (26h21m28.765418945s) [noise=true , address=104.36.82.56:4251 , piece_id=YA4VCKOQA5E2B7TF25I4JQWNRNKXSNC6E23W3XY77LPTF23WG2JA, seg_pos={0 0}, upload=25157]: Uploading piece... Jul 28 00:13:13.189966174 (26h21m28.970899552s) [upload=25157]: Next returned nil segment Jul 28 00:13:13.189983326 (26h21m28.970916692s) [upload=25157]: Waiting for error group managing segments... Jul 28 00:13:13.621200687 (26h21m29.402134056s) [noise=true , address=79.127.201.214:4291 , piece_id=WSWGLWB3QCDN7LVAYQ4PMHNXAIRNQUN2EC27MMH72AXF3ZOTLYUQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: <nil> Jul 28 00:13:14.450347470 (26h21m30.231280849s) [noise=true , address=64.49.13.138:4483 , piece_id=7HHKAGCEXD4KUVEOTIQW4YK6MRR57LQJMXYRZHS6TJO75CCIMH7Q, seg_pos={0 0}, upload=25157]: Done uploading piece. err: <nil> Jul 28 00:13:14.538549427 (26h21m30.319482811s) [noise=true , address=79.127.201.215:4343 , piece_id=2FPWHHI4O366U6WRP2PRVUGEKEL2F7A2WQAYZXYPVOYPA7PNGN3Q, seg_pos={0 0}, upload=25157]: Done uploading piece. err: <nil> Jul 28 00:14:12.912102155 (26h22m28.693035531s) [noise=true , address=104.36.82.16:4316 , piece_id=RXGU7UI3BQE4VL2TQAYEUZUB6QCJ2JG6ALIIJAFKJFI74EAWKEHA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf, address:104.36.82.16:4316): protocol: rpc: dial tcp 104.36.82.16:4316: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912253520 (26h22m28.693186895s) [noise=true , address=104.36.82.20:4447 , piece_id=CXGMHB62TKJ6NIYMVMGIIINYXHGMTD23BBHBYZUHGCM46ZZ2VUFQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:1Li8ZwrWGPx5Y478pYLwnWJ7N2x3dbXgwGaUGWVtVhvv61EnTs, address:104.36.82.20:4447): protocol: rpc: dial tcp 104.36.82.20:4447: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912347582 (26h22m28.693280968s) [noise=true , address=104.36.82.4:4825 , piece_id=6PCCIUN63YUI4VXDRIVM5C5FQXB7B4NBYJ57QNRDUSP6NCWNKFDA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:121Bec7R14ujGEdoUqFTikngLVLb6jmLAcHkeBAaCkhZ5dr6APb, address:104.36.82.4:4825): protocol: rpc: dial tcp 104.36.82.4:4825: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912449723 (26h22m28.693383098s) [noise=true , address=104.36.82.5:4872 , piece_id=YM6BND267SZEK2HOE7AHCU7LIGJLJ2P7PLV4EVCPACCDJZQZKFCA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: write tcp 159.223.143.39:50330->104.36.82.5:4872: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912653063 (26h22m28.693586453s) [noise=true , address=104.36.82.42:4814 , piece_id=GYTSXV42APDBOAUGUBHLSYO5H57KAOLXE3QL7UXH4LCNDSGITSUA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12rnmX5iuA5swKceTZVV14HLaUctRFimn3DPLjRogg4K3N7PWnU, address:104.36.82.42:4814): protocol: rpc: dial tcp 104.36.82.42:4814: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912722923 (26h22m28.693656311s) [noise=true , address=104.36.82.56:4251 , piece_id=YA4VCKOQA5E2B7TF25I4JQWNRNKXSNC6E23W3XY77LPTF23WG2JA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12vvYKd1KXrz8cYXRJSL9KXiYQtY95aB2GFPGFi9c9Nj1Raj6J4, address:104.36.82.56:4251): protocol: rpc: dial tcp 104.36.82.56:4251: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912786120 (26h22m28.693719481s) [noise=true , address=104.36.82.15:4279 , piece_id=PVYGX4X3QUGD3D6TD2NXENMLKHRQO5QTKXEAPN4CH4OWV3EXEFYQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12uiA6tmZtmHDNaNtkhRtH31q4MJxn3C4bfrLAXmYz5mKmofHoG, address:104.36.82.15:4279): protocol: rpc: dial tcp 104.36.82.15:4279: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912854267 (26h22m28.693787634s) [noise=true , address=104.36.82.14:4241 , piece_id=DLCOMMAKIULBHDCXOT75YUO5PAOJFRZW4UCGPHWQ5DW2CXEB2LLA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR, address:104.36.82.14:4241): protocol: rpc: dial tcp 104.36.82.14:4241: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912911508 (26h22m28.693844877s) [noise=true , address=104.36.82.13:4202 , piece_id=ZNMT57OYPDKVYPTMXLDUCEPFGF24ZPDTPM64GDABVXZM76ZHFISA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH, address:104.36.82.13:4202): protocol: rpc: dial tcp 104.36.82.13:4202: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.912954899 (26h22m28.693888274s) [noise=true , address=104.36.82.54:4165 , piece_id=FBXBURTZVPMXJE63UPPDDP6YPBDKOJCCSDWDR5U7AB4WVWUJDHJA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2, address:104.36.82.54:4165): protocol: rpc: dial tcp 104.36.82.54:4165: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.913027995 (26h22m28.693961371s) [noise=true , address=104.36.82.52:4100 , piece_id=6YR6JR2G3QGHMWFXD36HVW6VA5ZM2T7AOPV3BYLFK2VMR4G4KTDQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12JQ78Lg28PborUyvkyLJb5RikJ8zJSAT5GkpYSsZLc6HRmkhyw, address:104.36.82.52:4100): protocol: rpc: dial tcp 104.36.82.52:4100: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.913037598 (26h22m28.693970974s) [noise=true , address=104.36.82.6:4901 , piece_id=OI5GF6QFN7WOH52NWYJCZECLY5QDYFD5JGXOGRJMEXCEQVGQURBQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: rpc: dial tcp 104.36.82.6:4901: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.913113686 (26h22m28.694047063s) [noise=true , address=104.36.82.55:4226 , piece_id=WVMP3URSBIFGUTHGYVAZHIMITT6PB6TO6IJJ36QNBRC65ISWAXYA, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:1qN8jYqiZGuPjqHSp6siqdT4p33qvf1vYdAkMZKRnFgcQj9Ga3, address:104.36.82.55:4226): protocol: write tcp 159.223.143.39:35470->104.36.82.55:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.913119763 (26h22m28.694053131s) [noise=true , address=104.36.82.12:4174 , piece_id=MUBJTG2N5Q7CITTYLK6PBKK34QE7PKSRLCE544T23FNV6A4LJEPQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12ZqPqvh4SVpDmkpVKQXZUW48CtzV9VMeMGJoDZwA7KpNfmjfow, address:104.36.82.12:4174): protocol: write tcp 159.223.143.39:32996->104.36.82.12:4174: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.913177711 (26h22m28.694111087s) [noise=true , address=104.36.82.53:4156 , piece_id=TYYK7PPV2HXY3XIIEYB355AR5TS7ETLUWDUU3JNS66G32NPR64BQ, seg_pos={0 0}, upload=25157]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:104.36.82.53:4156): protocol: write tcp 159.223.143.39:60108->104.36.82.53:4156: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:14:12.913210562 (26h22m28.694143938s) [seg_pos={0 0}, upload=25157]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Jul 28 00:14:12.945831453 (26h22m28.72676483s) [upload=25157]: Done uploading segments... Jul 28 00:14:12.945859681 (26h22m28.726793062s) [upload=25157]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 1m0.036431268s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 364.775429ms FAIL (2025-07-28 00:14:12 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 11) Duration: 364.801553ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 443.007413ms FAIL (2025-07-28 00:13:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== rue , address=104.36.82.6:4873 , piece_id=KLIOIPDMSH43MPPYETZKI76CHTZZYKHSLXQHZ4BUMTAIHB2UDUFA, seg_pos={0 0}, upload=25145]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3): protocol: rpc: dial tcp 104.36.82.6:4873: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:19.224827526 (26h20m35.005760889s) [seg_pos={0 0}, upload=25145]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:12:19.224911362 (26h20m35.005844727s) [upload=25145]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:12:19.224918336 (26h20m35.005851717s) [upload=25145]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:12:19.362327161 (26h20m35.143260528s) [upload=25145]: Done uploading segments... Jul 28 00:12:19.362346149 (26h20m35.143279514s) [upload=25145]: Upload finished. err: <nil> Jul 28 00:12:51.446334860 (26h21m7.227268227s) [upload=25149]: Starting upload Jul 28 00:12:51.446464358 (26h21m7.22739772s) [upload=25149]: Done starting upload Jul 28 00:12:51.446704322 (26h21m7.227637707s) [upload=25149]: Uploading segments... Jul 28 00:12:51.446787742 (26h21m7.227721116s) [upload=25149]: Got next segment. Inline: false Jul 28 00:12:51.446833329 (26h21m7.227766709s) [upload=25149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:12:51.446840824 (26h21m7.227774219s) [upload=25149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:12:51.485529866 (26h21m7.26646325s) [seg_pos={0 0}, upload=25149]: Begin upload segment... Jul 28 00:12:51.485678448 (26h21m7.266611834s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486282709 (26h21m7.267216075s) [seg_pos={0 0}, upload=25149]: Done begin upload segment. Jul 28 00:12:51.486329800 (26h21m7.267263182s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486415444 (26h21m7.267348831s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486711407 (26h21m7.267644781s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487045013 (26h21m7.267978389s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487052683 (26h21m7.267986065s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487333539 (26h21m7.268266915s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487624449 (26h21m7.268557836s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487637388 (26h21m7.268570764s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487963294 (26h21m7.268896672s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488384188 (26h21m7.269317573s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488402235 (26h21m7.269335622s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488790390 (26h21m7.269723765s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488981948 (26h21m7.269915335s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489139202 (26h21m7.270072587s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489529535 (26h21m7.270462922s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.590540290 (26h21m7.371473675s) [upload=25149]: Next returned nil segment Jul 28 00:12:51.590561833 (26h21m7.371495207s) [upload=25149]: Waiting for error group managing segments... Jul 28 00:12:51.593971573 (26h21m7.374904937s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594092106 (26h21m7.375025476s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594518922 (26h21m7.375452292s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596497721 (26h21m7.377431102s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596767382 (26h21m7.377700774s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597122347 (26h21m7.378055738s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597394157 (26h21m7.378327548s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597631346 (26h21m7.378564711s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597978444 (26h21m7.378911823s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598114353 (26h21m7.379047716s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598550692 (26h21m7.379484054s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598693441 (26h21m7.37962682s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:13:21.415422049 (26h21m37.196355417s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: write tcp 159.223.143.39:39116->104.36.82.2:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415498914 (26h21m37.19643229s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: rpc: dial tcp 104.36.82.16:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415564035 (26h21m37.196497411s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415610198 (26h21m37.196543564s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: write tcp 159.223.143.39:58476->104.36.82.4:4804: use of closed network connection; conn closed: op Jul 28 00:13:21.415628115 (26h21m37.19656148s) [seg_pos={0 0}, upload=25149]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:13:21.442171782 (26h21m37.22310515s) [upload=25149]: Done uploading segments... Jul 28 00:13:21.442216456 (26h21m37.223149832s) [upload=25149]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 443.039016ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 416.931352ms FAIL (2025-07-28 00:13:42 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 11) Duration: 416.963078ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.037423039s FAIL (2025-07-28 00:13:36 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.037452646s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 199.836848ms FAIL (2025-07-28 00:13:31 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 199.868383ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.028617263s FAIL (2025-07-28 00:13:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== rue , address=104.36.82.6:4873 , piece_id=KLIOIPDMSH43MPPYETZKI76CHTZZYKHSLXQHZ4BUMTAIHB2UDUFA, seg_pos={0 0}, upload=25145]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3): protocol: rpc: dial tcp 104.36.82.6:4873: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:19.224827526 (26h20m35.005760889s) [seg_pos={0 0}, upload=25145]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 28 00:12:19.224911362 (26h20m35.005844727s) [upload=25145]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:12:19.224918336 (26h20m35.005851717s) [upload=25145]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:12:19.362327161 (26h20m35.143260528s) [upload=25145]: Done uploading segments... Jul 28 00:12:19.362346149 (26h20m35.143279514s) [upload=25145]: Upload finished. err: <nil> Jul 28 00:12:51.446334860 (26h21m7.227268227s) [upload=25149]: Starting upload Jul 28 00:12:51.446464358 (26h21m7.22739772s) [upload=25149]: Done starting upload Jul 28 00:12:51.446704322 (26h21m7.227637707s) [upload=25149]: Uploading segments... Jul 28 00:12:51.446787742 (26h21m7.227721116s) [upload=25149]: Got next segment. Inline: false Jul 28 00:12:51.446833329 (26h21m7.227766709s) [upload=25149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:12:51.446840824 (26h21m7.227774219s) [upload=25149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:12:51.485529866 (26h21m7.26646325s) [seg_pos={0 0}, upload=25149]: Begin upload segment... Jul 28 00:12:51.485678448 (26h21m7.266611834s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486282709 (26h21m7.267216075s) [seg_pos={0 0}, upload=25149]: Done begin upload segment. Jul 28 00:12:51.486329800 (26h21m7.267263182s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486415444 (26h21m7.267348831s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.486711407 (26h21m7.267644781s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487045013 (26h21m7.267978389s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487052683 (26h21m7.267986065s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487333539 (26h21m7.268266915s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487624449 (26h21m7.268557836s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487637388 (26h21m7.268570764s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.487963294 (26h21m7.268896672s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488384188 (26h21m7.269317573s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488402235 (26h21m7.269335622s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488790390 (26h21m7.269723765s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.488981948 (26h21m7.269915335s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489139202 (26h21m7.270072587s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.489529535 (26h21m7.270462922s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Uploading piece... Jul 28 00:12:51.590540290 (26h21m7.371473675s) [upload=25149]: Next returned nil segment Jul 28 00:12:51.590561833 (26h21m7.371495207s) [upload=25149]: Waiting for error group managing segments... Jul 28 00:12:51.593971573 (26h21m7.374904937s) [noise=true , address=45.91.116.12:4226 , piece_id=R43ZVZ7HUPUFPGSPYRCSZMN3LB4WSKIIUNGNZJQKNDWW27GK7APQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594092106 (26h21m7.375025476s) [noise=true , address=45.91.116.4:4937 , piece_id=TDDSEA6WJHAYPD4RITP2W5BOJS55L2DQOSTRBJHLIDNMAAX4L5SA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.594518922 (26h21m7.375452292s) [noise=true , address=45.91.116.5:4298 , piece_id=A7V4OE6KOWXV63QSDCGNLXPE32NIL7MLGJMZTLGRZHIG3FJQLCYA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596497721 (26h21m7.377431102s) [noise=true , address=45.91.116.9:4263 , piece_id=55Q5ELBLWNPMVSJ2GYRJ5NCOZF75JWAOMOPX7OQRHYNFWG4SU5JQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.596767382 (26h21m7.377700774s) [noise=true , address=77.90.31.15:4699 , piece_id=V6MLSEIOGLEQNKZCOTF7Y3CCBD5ATG7JHFSKTYCC53E4SJZO5GUQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597122347 (26h21m7.378055738s) [noise=true , address=77.90.31.18:4805 , piece_id=YACHLGLUW37BOIBF36YS47THEVYNYWY7TTRN3VTWM5SKNMC5QIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597394157 (26h21m7.378327548s) [noise=true , address=45.91.116.5:4297 , piece_id=EQSG7A6M5GVB7SSAP6P5RHLITZKDFGQCKDB6JSJJ5XV7II25BUVA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597631346 (26h21m7.378564711s) [noise=true , address=77.90.31.10:4519 , piece_id=VR3BU5O2ZGM4OHJTLWU4AWGSSJA26THN5KXXAI5RZR2WOAGGFIFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.597978444 (26h21m7.378911823s) [noise=true , address=77.90.31.11:4555 , piece_id=5ODJAJ4HZBJYYMQ2U6GPZYC7TNCJ7P3EQDIWAHA6AY2I4AIXHPUA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598114353 (26h21m7.379047716s) [noise=true , address=45.91.116.7:4011 , piece_id=AONDOO2JZKGYJI6MB7BVMBXUPFQOMYZYDGBAS23VMSRSNJPYKKSA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598550692 (26h21m7.379484054s) [noise=true , address=45.91.116.10:4083 , piece_id=H3MU35YXKQ5HXXXYQ7L3EQXMSKW2BOLDS5JFR4DRD6QFQEDRHNMA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:12:51.598693441 (26h21m7.37962682s) [noise=true , address=45.91.116.11:4117 , piece_id=CZ6EZULUJSMFUNCDCE76T4TQVI7UXLTU7MGBE3OKQB3GKNWBUBDA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: <nil> Jul 28 00:13:21.415422049 (26h21m37.196355417s) [noise=true , address=104.36.82.2:4730 , piece_id=LPXMNPGLJ6D4VSUKQ6UQQLPKLWR4ADAJZHPR37T3LUVLCDYKWZMQ, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:104.36.82.2:4730): protocol: write tcp 159.223.143.39:39116->104.36.82.2:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415498914 (26h21m37.19643229s) [noise=true , address=104.36.82.16:4294 , piece_id=ZWXMPUMPS3YZFP4YCTOT3OPY45PNRBLKJ6IFABLFANJ4HJ5W5DFA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: rpc: dial tcp 104.36.82.16:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415564035 (26h21m37.196497411s) [noise=true , address=104.36.82.15:4259 , piece_id=7WJ4YW33BSSBNMMSPNOZN3IUUTVBRKTDHXG4TEK6R2QFIJNWONQA, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:21.415610198 (26h21m37.196543564s) [noise=true , address=104.36.82.4:4804 , piece_id=RDQSGNNW3AU6UIWGK2OHJSLKMZPDELUOU2T2ANDO26F4ND6B6A4Q, seg_pos={0 0}, upload=25149]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: write tcp 159.223.143.39:58476->104.36.82.4:4804: use of closed network connection; conn closed: op Jul 28 00:13:21.415628115 (26h21m37.19656148s) [seg_pos={0 0}, upload=25149]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 28 00:13:21.442171782 (26h21m37.22310515s) [upload=25149]: Done uploading segments... Jul 28 00:13:21.442216456 (26h21m37.223149832s) [upload=25149]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.028640755s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [...................................................XXX.XXXXX] duration: 1m0.028592919s FAIL (2025-07-28 00:13:07 UTC) ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== .123893136s) [noise=true , address=104.36.82.56:4253 , piece_id=JC6VQQH5P4ERA3QKN2W7H4ZCC5A6ITESZKUOBYNMSYATOUJBBECQ, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:12:07.343460119 (26h20m23.124393506s) [noise=true , address=104.36.82.13:4196 , piece_id=YYVFDLRGYKEJCKJY5DXAIY2YPVGIZPNAX3RBLU5VJVML7OW7NQFQ, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:12:07.353379830 (26h20m23.134313216s) [noise=true , address=104.36.82.12:4179 , piece_id=C5E4N56NVTCR6XIVCU7SNVZ5CH2X4LQDWR7VJJGAM2QPAVGS3GXA, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:12:07.353919132 (26h20m23.134852516s) [noise=true , address=104.36.82.55:4198 , piece_id=VBDHF4NL2FNLKSDXMLDBOKVQ73VOLDOZ6HOA7LRGM674RQGGMPSQ, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:12:07.354405150 (26h20m23.135338536s) [noise=true , address=104.36.82.46:4513 , piece_id=RNEP22LW33SCXDZCPANARBUQ7EAAT46CE74KLNLQSRYN7X3WQCIA, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:12:07.354801595 (26h20m23.135734982s) [noise=true , address=104.36.82.21:4475 , piece_id=4YKN35GO4EQEJLEPJB3JNZLJDNT3ZGZCBCG2RWAC33NRG5FBYUXA, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:12:07.355216057 (26h20m23.136149437s) [noise=true , address=104.36.82.14:4229 , piece_id=F52Z3UVUVA7GUDIF5NVEJZQ637JTI5J3AYDZLJCMMOJO5B4KVCPA, seg_pos={0 0}, upload=25141]: Uploading piece... Jul 28 00:13:07.267331858 (26h21m23.048265236s) [upload=25141]: Next segment err: context deadline exceeded Jul 28 00:13:07.267449330 (26h21m23.048382708s) [noise=true , address=104.36.82.15:4268 , piece_id=WRZW72QD5LL745OFJQQ2O2DCGP3B7QPBZODIA7KGOJVTUY55UOZA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:112ocg8g8hf2huUskC1Kty3z51wXc8VuNUgARTFjKZxsF6RFFy, address:104.36.82.15:4268): protocol: write tcp 159.223.143.39:34046->104.36.82.15:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267541248 (26h21m23.048474621s) [noise=true , address=104.36.82.13:4200 , piece_id=WPNXRIKPTYX7A4YVLS3DQ6U6AWF6E5D6MG4DD52OTF2ZAW4GOZPA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:12dfLumooVsDsWXqi5FQMDutkcexM9A5Kmu4Vo9s1TqfWxv5ozH, address:104.36.82.13:4200): protocol: write tcp 159.223.143.39:41434->104.36.82.13:4200: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267629076 (26h21m23.048562458s) [noise=true , address=104.36.82.21:4475 , piece_id=4YKN35GO4EQEJLEPJB3JNZLJDNT3ZGZCBCG2RWAC33NRG5FBYUXA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:104.36.82.21:4475): protocol: write tcp 159.223.143.39:47970->104.36.82.21:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267686400 (26h21m23.048619773s) [noise=true , address=104.36.82.56:4253 , piece_id=JC6VQQH5P4ERA3QKN2W7H4ZCC5A6ITESZKUOBYNMSYATOUJBBECQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap, address:104.36.82.56:4253): protocol: write tcp 159.223.143.39:36380->104.36.82.56:4253: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267758464 (26h21m23.048691853s) [noise=true , address=104.36.82.55:4198 , piece_id=VBDHF4NL2FNLKSDXMLDBOKVQ73VOLDOZ6HOA7LRGM674RQGGMPSQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:104.36.82.55:4198): protocol: write tcp 159.223.143.39:39324->104.36.82.55:4198: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267817056 (26h21m23.048750432s) [noise=true , address=104.36.82.16:4319 , piece_id=I37OS7WF6FVJHP2BLFTX42GTXA4SXYMBVBVC264TGPCDBJY5OBIQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C, address:104.36.82.16:4319): protocol: rpc: dial tcp 104.36.82.16:4319: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267864114 (26h21m23.048797482s) [noise=true , address=104.36.82.11:4136 , piece_id=QKU2JEIDIZ5Z43QNBTNU2Y6X76E75FLFGSMQIDUXVQTTBQFV35UQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:127n8CMbZQ7haiv6tGHrVg9V8Yf12sYkcbL9mEbSpQ4WkT9isnp, address:104.36.82.11:4136): protocol: write tcp 159.223.143.39:51398->104.36.82.11:4136: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267917602 (26h21m23.048850977s) [noise=true , address=104.36.82.52:4087 , piece_id=HXKQJCIVMZ6IYOSL2QIGPFVQQPZSRTDDYCO4QFTXSU3LZTWSGWCQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1BfeGD2MGRPqsBRGLioTiTAcPykpSTUUx2CBVSPQcz4LQqFdWR, address:104.36.82.52:4087): protocol: rpc: dial tcp 104.36.82.52:4087: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.267991526 (26h21m23.048924891s) [noise=true , address=104.36.82.4:4825 , piece_id=4RFZWOYMBMDR7SYIMJFOPKI5EF3W3EPCAYD2PQ53D76JFWFZBH5A, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:121Bec7R14ujGEdoUqFTikngLVLb6jmLAcHkeBAaCkhZ5dr6APb, address:104.36.82.4:4825): protocol: write tcp 159.223.143.39:46644->104.36.82.4:4825: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268015470 (26h21m23.04894885s) [noise=true , address=104.36.82.44:4895 , piece_id=WJ6GHPOTOBEG7ZA2RLJ5T2PEHIUPU5AXCAKR6ACFR2DS2RD2NKCA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu, address:104.36.82.44:4895): protocol: rpc: dial tcp 104.36.82.44:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268053916 (26h21m23.048987281s) [noise=true , address=104.36.82.47:4524 , piece_id=YZ6FHN4X3AGOTE7IZWJCVIG4CWF2GJU44XBVYGEI2NK7J7VEU6IA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1xfbCzjSwFDRrR1gPggeN8tNCLbRRWDVzCJ6mqhZsbVSe8d4s4, address:104.36.82.47:4524): protocol: write tcp 159.223.143.39:32982->104.36.82.47:4524: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268107324 (26h21m23.04904069s) [noise=true , address=104.36.82.14:4229 , piece_id=F52Z3UVUVA7GUDIF5NVEJZQ637JTI5J3AYDZLJCMMOJO5B4KVCPA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:12uiCMvJ7pnwXfN57CVu8zR73tikwUZiXr3sG7Xotd9w6KVnViL, address:104.36.82.14:4229): protocol: rpc: dial tcp 104.36.82.14:4229: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268330067 (26h21m23.049263446s) [noise=true , address=104.36.82.49:4000 , piece_id=X6YJBZ35ZQUKCFNS5QKDPHAADX3CEQ224FZ53ZM56JW6364XN6NA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:12chhfe1weiPC1jjv8vbScP7uFVNXFr6s3UcNRkH8gsSAtGD16D, address:104.36.82.49:4000): protocol: rpc: dial tcp 104.36.82.49:4000: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268404831 (26h21m23.049338208s) [noise=true , address=104.36.82.13:4196 , piece_id=YYVFDLRGYKEJCKJY5DXAIY2YPVGIZPNAX3RBLU5VJVML7OW7NQFQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1aLZa6kv5VhDgqvUZp2HkzpkbA81KU13iGTTsiVfSeUDzLu8Lu, address:104.36.82.13:4196): protocol: rpc: dial tcp 104.36.82.13:4196: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268426132 (26h21m23.049359508s) [noise=true , address=104.36.82.40:4966 , piece_id=ECYGFLQHPE7LF63FOHF7VRD7GU3PMDOP25GDIZR6PRR4IF45TYSQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1DLnsYVdudE4mY9dNAQKhBRppUEAHvxbf84KX69451pwxSxzZK, address:104.36.82.40:4966): protocol: rpc: dial tcp 104.36.82.40:4966: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268447661 (26h21m23.049381028s) [noise=true , address=104.36.82.46:4513 , piece_id=RNEP22LW33SCXDZCPANARBUQ7EAAT46CE74KLNLQSRYN7X3WQCIA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:12pyyW8Gdqg6j9YGMtCUBhFnoNXryvPMUy19x815dp2HV3Xqr8h, address:104.36.82.46:4513): protocol: write tcp 159.223.143.39:55222->104.36.82.46:4513: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268457887 (26h21m23.049391256s) [noise=true , address=104.36.82.6:4886 , piece_id=7AANXPZGE5QVG6XF75UY56KYAFB66WEC4NAVRNELVJBGFALKHKKQ, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:1QyBnKe6fVUVSg38Hv6aPP6pY7haXCa4kQb45LHkPTSdTWHjkF, address:104.36.82.6:4886): protocol: write tcp 159.223.143.39:49550->104.36.82.6:4886: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268483566 (26h21m23.049416935s) [noise=true , address=104.36.82.12:4179 , piece_id=C5E4N56NVTCR6XIVCU7SNVZ5CH2X4LQDWR7VJJGAM2QPAVGS3GXA, seg_pos={0 0}, upload=25141]: Done uploading piece. err: ecclient: upload failed (node:129pP9f3rFfTvP6MhG894N7WHuJRZP8aWhzJf1zBwZ76wbzVbZa, address:104.36.82.12:4179): protocol: rpc: dial tcp 104.36.82.12:4179: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:13:07.268524307 (26h21m23.049457684s) [seg_pos={0 0}, upload=25141]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m0.028615629s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 301.259041ms FAIL (2025-07-28 00:12:26 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 301.282375ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [....................................................XXX.XXXX] duration: 1m0.036061248s FAIL (2025-07-28 00:12:07 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== piece_id=LQXFQ6YA5PGLFPUMNUPEI6Q5OZ7ECM5G2TJRPTPUIDULVWHEK4CQ, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.228794405 (26h19m23.009727795s) [noise=true , address=104.36.82.49:4001 , piece_id=L2ZTVGVFZVVXOYUMIAGLP4G5WSX7CGI6RF3ZCPYNFADPPRALOLQA, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.229238021 (26h19m23.010171411s) [noise=true , address=104.36.82.52:4098 , piece_id=ULG6O4MSC2FM33V5CBFU5SE3WJUCX2IR7V3VOKYNDDXRPPZVGB5Q, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.229326021 (26h19m23.010259443s) [noise=true , address=104.36.82.12:4167 , piece_id=Q6L6CXWCD2OC3SOJDVMRV4LUAHEGRCM7VR4E7HRDXGB4EWSBS56Q, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.229805823 (26h19m23.010739209s) [noise=true , address=104.36.82.53:4137 , piece_id=7ZMSCY4TDG7F5CDDOR7DQTVJV7ZWXEJFF3CJCHB62KSN5MKM2RTQ, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.230477820 (26h19m23.011411211s) [noise=true , address=104.36.82.50:4040 , piece_id=MNVSSLTPV23U7KA3BCELCBUHBYKUW6SKA6UWLW6YPQR53FTYWWXA, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.230978688 (26h19m23.01191216s) [noise=true , address=104.36.82.55:4220 , piece_id=N52BMPB4SWD7BTNEG5YEGDSRACLGDJYAA6UWA3N5XR6D4WVUQREA, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.231401150 (26h19m23.012334541s) [noise=true , address=104.36.82.41:4777 , piece_id=CFKLLBIUYABNM45F23VN2P5K6XAI42S3BFASPJ6F6QDOJQOZLYYQ, seg_pos={0 0}, upload=25127]: Uploading piece... Jul 28 00:11:07.324161266 (26h19m23.105094648s) [upload=25127]: Next returned nil segment Jul 28 00:11:07.324192263 (26h19m23.105125657s) [upload=25127]: Waiting for error group managing segments... Jul 28 00:11:07.470726304 (26h19m23.251659688s) [noise=true , address=77.90.31.16:4744 , piece_id=LQXFQ6YA5PGLFPUMNUPEI6Q5OZ7ECM5G2TJRPTPUIDULVWHEK4CQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: <nil> Jul 28 00:11:08.190141210 (26h19m23.971074581s) [noise=true , address=64.49.13.169:4710 , piece_id=YA5QWZDTUG6MNBGHXYFRLIFHRCAGM57CRBKL4DGDESJPEB3CPNGQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: <nil> Jul 28 00:11:08.370272398 (26h19m24.15120578s) [noise=true , address=79.127.201.215:4359 , piece_id=RM7OKIUXHZPBPHTHU5DPDLDJNQUGBEPBP7DU3TSCUAOHF7ZVUQZA, seg_pos={0 0}, upload=25127]: Done uploading piece. err: <nil> Jul 28 00:12:07.150221139 (26h20m22.931154506s) [noise=true , address=104.36.82.50:4040 , piece_id=MNVSSLTPV23U7KA3BCELCBUHBYKUW6SKA6UWLW6YPQR53FTYWWXA, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:12gozJwRZvMK7Vbsdy775PtGynixvh3z5MHWwaLxzkrExseZosn, address:104.36.82.50:4040): protocol: write tcp 159.223.143.39:49794->104.36.82.50:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150316034 (26h20m22.931249401s) [noise=true , address=104.36.82.55:4220 , piece_id=N52BMPB4SWD7BTNEG5YEGDSRACLGDJYAA6UWA3N5XR6D4WVUQREA, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:15jMrmLPcRL8VeYUPzYNPhc2N7qZt4QgTsrSHoo4Zrt4cGrHHK, address:104.36.82.55:4220): protocol: write tcp 159.223.143.39:40840->104.36.82.55:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150403437 (26h20m22.931336799s) [noise=true , address=104.36.82.41:4777 , piece_id=CFKLLBIUYABNM45F23VN2P5K6XAI42S3BFASPJ6F6QDOJQOZLYYQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1Pvm1SftEF3tnCEBqUn1ZmyVcLDBkR6pyegEb7mtzjdQiiqYqt, address:104.36.82.41:4777): protocol: write tcp 159.223.143.39:43786->104.36.82.41:4777: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150500465 (26h20m22.931433833s) [noise=true , address=104.36.82.56:4233 , piece_id=TYTBLKIVEYMJF7Q4KWY2TA6RHQMKSRUAO7JD6J2YU4SAYZZU3OTQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:104.36.82.56:4233): protocol: write tcp 159.223.143.39:48392->104.36.82.56:4233: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150569714 (26h20m22.93150308s) [noise=true , address=104.36.82.15:4270 , piece_id=M4C64K7LIUYFYCFPU3BIVA2TRI3JHY6Y3W64FES4WCCJKHUUNMCQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: write tcp 159.223.143.39:59074->104.36.82.15:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150632799 (26h20m22.931566165s) [noise=true , address=104.36.82.42:4797 , piece_id=KGH4M6FVNS3B3CJL6A5ZKSW6HLDLHP6A6KWDBNKNI2HSBPFRSV7Q, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, address:104.36.82.42:4797): protocol: write tcp 159.223.143.39:32854->104.36.82.42:4797: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150683045 (26h20m22.93161641s) [noise=true , address=104.36.82.53:4154 , piece_id=P6S7AIDIS26A6CFIF7T2W26W7QCLWIHSAF6ENDAKIXDAPVOIDEIA, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1vbGunXCRMkmfvBqHPmbuW7fBLKck4Vh9MGsX1q7P6VfX6DKqB, address:104.36.82.53:4154): protocol: write tcp 159.223.143.39:59490->104.36.82.53:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150759934 (26h20m22.931693297s) [noise=true , address=104.36.82.47:4517 , piece_id=LJICEH742SXNVJA2IR7JEZE4G2GBZXUOUAZNCIOTYOVOF22PE7VQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS, address:104.36.82.47:4517): protocol: write tcp 159.223.143.39:53584->104.36.82.47:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150958689 (26h20m22.931892056s) [noise=true , address=104.36.82.12:4167 , piece_id=Q6L6CXWCD2OC3SOJDVMRV4LUAHEGRCM7VR4E7HRDXGB4EWSBS56Q, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:12sGc7qmx3smXoPkf6zMMt57V8VhF1kHaPhExKCe873fEm9yUih, address:104.36.82.12:4167): protocol: write tcp 159.223.143.39:44036->104.36.82.12:4167: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.150999721 (26h20m22.93193309s) [noise=true , address=104.36.82.53:4137 , piece_id=7ZMSCY4TDG7F5CDDOR7DQTVJV7ZWXEJFF3CJCHB62KSN5MKM2RTQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1dZZBaTDA1kbdJmNZzzYgdPkKE2rNvEqdWaMGUxuTD2ERbSanc, address:104.36.82.53:4137): protocol: write tcp 159.223.143.39:58126->104.36.82.53:4137: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.151244168 (26h20m22.932177535s) [noise=true , address=104.36.82.49:4001 , piece_id=L2ZTVGVFZVVXOYUMIAGLP4G5WSX7CGI6RF3ZCPYNFADPPRALOLQA, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1iZnfkAxoot7KjtjYbxbSFvDhDFcLd8M63Qkh67GuMXMJjdruD, address:104.36.82.49:4001): protocol: write tcp 159.223.143.39:37978->104.36.82.49:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.151324479 (26h20m22.932257846s) [noise=true , address=104.36.82.52:4120 , piece_id=VQ5UDX5WFG6MMVPPJG5LLGG56KV4PN3ORVK5CKZPFVOT2SGPSNHQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1aKMhWsxNocDaqpuPLy7177jEA9K6MrsuKi1awcDcod3mM1vM3, address:104.36.82.52:4120): protocol: write tcp 159.223.143.39:57694->104.36.82.52:4120: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.151394793 (26h20m22.932328159s) [noise=true , address=104.36.82.52:4098 , piece_id=ULG6O4MSC2FM33V5CBFU5SE3WJUCX2IR7V3VOKYNDDXRPPZVGB5Q, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1SoFNdwfh4p5tXUkpfjQaev6tdA2ZdhsXUFvZNBsy5QrJ9zdqb, address:104.36.82.52:4098): protocol: write tcp 159.223.143.39:45430->104.36.82.52:4098: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.151447741 (26h20m22.932381106s) [noise=true , address=104.36.82.10:4089 , piece_id=TGHXQ3KH24RH6FVIXIQFIL4BYO33F6ESRMCVX7UVHSU4HTWFJXNQ, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:104.36.82.10:4089): protocol: write tcp 159.223.143.39:42254->104.36.82.10:4089: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.151508497 (26h20m22.932441864s) [noise=true , address=104.36.82.44:4904 , piece_id=7U6XIARKSQJZLGVWBBJFAH6PSDDFAT52JVRRTTJ3ZNSYKGXZAT2Q, seg_pos={0 0}, upload=25127]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:104.36.82.44:4904): protocol: write tcp 159.223.143.39:58054->104.36.82.44:4904: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:12:07.151545909 (26h20m22.932479285s) [seg_pos={0 0}, upload=25127]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Jul 28 00:12:07.182193783 (26h20m22.963127162s) [upload=25127]: Done uploading segments... Jul 28 00:12:07.182223279 (26h20m22.963156657s) [upload=25127]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 1m0.036100642s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 346.249556ms FAIL (2025-07-28 00:11:20 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 346.283179ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.....................................................XXX.XXX] duration: 1m0.033918169s FAIL (2025-07-28 00:11:07 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== _id=NC7GTHCIONNKDCIONWFGZX72CJ2SH3PTWUR4UNWFKDNXGZXBJFNA, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.113861490 (26h18m22.894794876s) [noise=true , address=104.36.82.55:4221 , piece_id=27XVA4SQYSG7UUQSMW3MXUNGPJS5LSFSWCVLXXPVC7R74WHKTVFQ, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.114434517 (26h18m22.895367907s) [noise=true , address=104.36.82.12:4166 , piece_id=ML5QZRNWYH56WHWWIBJSUAWRLJVOWXSEKCNT273QLBI5GRYDVFUQ, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.114981744 (26h18m22.895915108s) [noise=true , address=64.49.13.140:4508 , piece_id=CCY7CX46PDO2BJE3XW6AEWOB34HAI5C4OWR25QH6W7FSBSAA46GQ, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.115545854 (26h18m22.896479243s) [noise=true , address=79.127.201.215:4359 , piece_id=JV5VWUDMKHV2DMD4SJLEVTL5X2NCXWR4AEIF5AEAZFVBUTOT3YNA, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.115729511 (26h18m22.896662894s) [noise=true , address=104.36.82.54:4170 , piece_id=FQ6HOCO2Y2AUGMKE33IFW2A24WW6FQK33YKZUWDAJJIOLAXOCIXA, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.116285576 (26h18m22.897218964s) [noise=true , address=104.36.82.46:4512 , piece_id=MOH66FTGOGMGQRW7VGJTFQPTVHAP4Q4DREKRDNO3WGOQNB6BNVRQ, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.119766963 (26h18m22.900700352s) [noise=true , address=104.36.82.51:4072 , piece_id=BUZDWOZRJKBXTGAD2NEARDKPMG66PIZBTUVQ2AQPAEDONHIIKOVA, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.120353166 (26h18m22.901286545s) [noise=true , address=104.36.82.16:4326 , piece_id=RFH6XMAGUNE5NKOPYZ6X2HX23K323LPBEZHCRVAKNFTAPZXEJF7A, seg_pos={0 0}, upload=25110]: Uploading piece... Jul 28 00:10:07.344004263 (26h18m23.124937625s) [upload=25110]: Next returned nil segment Jul 28 00:10:07.344029690 (26h18m23.124963079s) [upload=25110]: Waiting for error group managing segments... Jul 28 00:10:07.904773654 (26h18m23.685707028s) [noise=true , address=64.49.13.140:4508 , piece_id=CCY7CX46PDO2BJE3XW6AEWOB34HAI5C4OWR25QH6W7FSBSAA46GQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: <nil> Jul 28 00:10:08.059921348 (26h18m23.840854711s) [noise=true , address=79.127.201.215:4359 , piece_id=JV5VWUDMKHV2DMD4SJLEVTL5X2NCXWR4AEIF5AEAZFVBUTOT3YNA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: <nil> Jul 28 00:11:07.031471503 (26h19m22.812404886s) [noise=true , address=104.36.82.51:4072 , piece_id=BUZDWOZRJKBXTGAD2NEARDKPMG66PIZBTUVQ2AQPAEDONHIIKOVA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.031570096 (26h19m22.812503477s) [noise=true , address=104.36.82.16:4326 , piece_id=RFH6XMAGUNE5NKOPYZ6X2HX23K323LPBEZHCRVAKNFTAPZXEJF7A, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12pU8MZZKS88CPFdZoaQ4msNfkCbCewTmS2wKEdN7pG5aCWoAr6, address:104.36.82.16:4326): protocol: rpc: dial tcp 104.36.82.16:4326: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.031677617 (26h19m22.812610995s) [noise=true , address=104.36.82.55:4228 , piece_id=CZ3EIL7NXPHIB6CEJQRVZW3IRC3BK2MFYMYFXNZLEILNL3TAM7VA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12NBsd33JtAwPdcbD8vBzZUYpjiqZpRzs8y2QrYJFE245pd8T5X, address:104.36.82.55:4228): protocol: rpc: dial tcp 104.36.82.55:4228: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.031742479 (26h19m22.812675856s) [noise=true , address=104.36.82.49:4977 , piece_id=3JSD562HGVBIGRKS6NINOL4Q5Y2RHIDWQH66B6AWKAHIUH5ONAZQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8, address:104.36.82.49:4977): protocol: rpc: dial tcp 104.36.82.49:4977: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.031807561 (26h19m22.812740943s) [noise=true , address=104.36.82.53:4143 , piece_id=XEO2IJS4BLCLOHSNSM77EQRKNNA3AQ7YO2KKAQUGU2DZP2FUFXEA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12EBnXkxXyf7TYw89gDnoHNpKPyBpNhdT46CipJwjqr6Cg6jxMQ, address:104.36.82.53:4143): protocol: rpc: dial tcp 104.36.82.53:4143: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.031867891 (26h19m22.812801268s) [noise=true , address=104.36.82.55:4221 , piece_id=27XVA4SQYSG7UUQSMW3MXUNGPJS5LSFSWCVLXXPVC7R74WHKTVFQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:1ssFiXk5oKTgnVMJ5TBJuSXuD1D2C46gT2hcY6yaDxf8fL1cjm, address:104.36.82.55:4221): protocol: rpc: dial tcp 104.36.82.55:4221: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.031944403 (26h19m22.812877772s) [noise=true , address=104.36.82.15:4271 , piece_id=5ANLKMZF2AEDJ5A4PKVUCYPAIWOVF5CO3GYG7VNKPINZNIAYQDJA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:1T9uQjynbTYcaixhvHWCKzatRWpFxMonHFi5idiMQtvivupKSu, address:104.36.82.15:4271): protocol: write tcp 159.223.143.39:39276->104.36.82.15:4271: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032027827 (26h19m22.812961208s) [noise=true , address=104.36.82.14:4251 , piece_id=NC7GTHCIONNKDCIONWFGZX72CJ2SH3PTWUR4UNWFKDNXGZXBJFNA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12btf6Z38aTMx7MaBxhUyZtFqUPgeMtP2aU8Y6FbV8zwu57zArd, address:104.36.82.14:4251): protocol: write tcp 159.223.143.39:44966->104.36.82.14:4251: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032097573 (26h19m22.813030951s) [noise=true , address=104.36.82.50:4015 , piece_id=YCUSL2L3NYQF23RINQ4QVAAAAAENFBSOTESQK5EYTXKOSKD4QYWQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:18etsqD4wpYunpwdbPETCAn3JGJawbFAK9mwTkVUYKuWB7ypQE, address:104.36.82.50:4015): protocol: rpc: dial tcp 104.36.82.50:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032388652 (26h19m22.813322032s) [noise=true , address=104.36.82.5:4852 , piece_id=XSC7BB2GS2R465AJ64LKGA7ITQYTKCRO3BIYNSOEYFK42KOPUPBQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:104.36.82.5:4852): protocol: rpc: dial tcp 104.36.82.5:4852: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032456608 (26h19m22.813389971s) [noise=true , address=104.36.82.52:4112 , piece_id=ZLHKEH4H66KHWL4NAWJ7GN3PWG3RBHNJZDCVANKW23XTYNJ53TFA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:1dQFyMxQ1vVeHWCmyUWFUtJNBTdRUP2bbdLJQCMwF9z1L1eapD, address:104.36.82.52:4112): protocol: rpc: dial tcp 104.36.82.52:4112: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032499576 (26h19m22.813432953s) [noise=true , address=104.36.82.46:4512 , piece_id=MOH66FTGOGMGQRW7VGJTFQPTVHAP4Q4DREKRDNO3WGOQNB6BNVRQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:1rUdrYUJgCF8aa3MdNe82dT765nqW46by7mJ2phMSpfHAhzgU2, address:104.36.82.46:4512): protocol: rpc: dial tcp 104.36.82.46:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032542772 (26h19m22.81347616s) [noise=true , address=104.36.82.13:4198 , piece_id=EJ5YRH3MDUCEXZYH64QKGMV26RNPUR6DUIVLQYOPL76W4EAG5A3Q, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:1Fj2mNZexPwM4B48kxLin8GF17KJN1RxNcZjGkD36LDviUevFm, address:104.36.82.13:4198): protocol: write tcp 159.223.143.39:36776->104.36.82.13:4198: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032586282 (26h19m22.813519663s) [noise=true , address=104.36.82.12:4166 , piece_id=ML5QZRNWYH56WHWWIBJSUAWRLJVOWXSEKCNT273QLBI5GRYDVFUQ, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12iCB7c4ZfpqafpD1PtpbE6BfU81wJW65LmrPVJXtD58yeuoR9t, address:104.36.82.12:4166): protocol: write tcp 159.223.143.39:54766->104.36.82.12:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032596691 (26h19m22.813530072s) [noise=true , address=104.36.82.54:4170 , piece_id=FQ6HOCO2Y2AUGMKE33IFW2A24WW6FQK33YKZUWDAJJIOLAXOCIXA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:1mcYgUVVeD2xo4pDhR7ywPLRgyA7GgejeErtLiWiPTV2AhbBRX, address:104.36.82.54:4170): protocol: rpc: dial tcp 104.36.82.54:4170: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032671862 (26h19m22.813605242s) [noise=true , address=104.36.82.42:4831 , piece_id=5AK4Z2O3HM7O3CGOUKCVFZ5ZXHBVYASN242U4Y3PAIFND3CSYMGA, seg_pos={0 0}, upload=25110]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:11:07.032728311 (26h19m22.813661695s) [seg_pos={0 0}, upload=25110]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Jul 28 00:11:07.061820489 (26h19m22.842753865s) [upload=25110]: Done uploading segments... Jul 28 00:11:07.061846430 (26h19m22.842779807s) [upload=25110]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 1m0.033952597s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 390.587824ms FAIL (2025-07-28 00:10:23 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 390.629355ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [......................................................XXX.XX] duration: 1m0.029113552s FAIL (2025-07-28 00:09:56 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 5) ======LOGS====== EFAY3MBQA, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.755601121 (26h17m12.536534503s) [noise=true , address=104.36.82.9:4020 , piece_id=RAQPJMS2CPLJXE7X3KYNRM6NRR4OHJCJF7WMM6OT7HRO5RPZ3W4Q, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.755930616 (26h17m12.536863997s) [noise=true , address=104.36.82.53:4149 , piece_id=EWRYGOBKE456AWWWQJNR7NTUGHO6MLJ66RBYD2VRMO3LFX2PWSUA, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.755956043 (26h17m12.536889424s) [noise=true , address=104.36.82.40:4961 , piece_id=DFI6BPZNX7QI6PJJJNYJPF6NVTZSGCCSM3SQG3Z2ZQHHPQPAECTQ, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.756466667 (26h17m12.537400052s) [noise=true , address=104.36.82.41:4766 , piece_id=Z7QD5VZFYBW3EBBZPTJ4JI72XQSRVRAGRJP7PGWUNSBHYYXBWOGA, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.756621948 (26h17m12.537555327s) [noise=true , address=104.36.82.10:4088 , piece_id=HWUY6AYKVUSK3YAG5AMNXU75YICROA3QJ6CGU5KWEGZKC43SNFNQ, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.757097702 (26h17m12.538031084s) [noise=true , address=104.36.82.22:4543 , piece_id=LMULETYDL25GGECETR7BEEWKUQ6N2VJQY6ANXROQT3R3YIWMMXRQ, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.758444663 (26h17m12.539378029s) [noise=true , address=104.36.82.15:4269 , piece_id=CP57H4KDAY5OGPYA3BAUJKLGUXRYE6MONV3QUDZLJ27BVH56YT5Q, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.760808951 (26h17m12.541742332s) [noise=true , address=104.36.82.36:4637 , piece_id=NNM2UYCFQ33RTIKKBQI33MAICSI6IGYSO5TE62X72YJQNEPFHQKA, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.762122343 (26h17m12.543055745s) [noise=true , address=77.90.31.10:4550 , piece_id=A6GUM4OQVM2CQBNOIRZQO7T3NAZJPGCDZRBFL5QONLA6GQKXBEYQ, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.763478998 (26h17m12.544412383s) [noise=true , address=104.36.82.47:4520 , piece_id=GHZKFDDKGWPRR6JFIGHE25AFHTJ6K4GPZHAWYINLEJDGCS76NMZQ, seg_pos={0 0}, upload=25094]: Uploading piece... Jul 28 00:08:56.833052604 (26h17m12.613985985s) [upload=25094]: Next returned nil segment Jul 28 00:08:56.833070501 (26h17m12.614003879s) [upload=25094]: Waiting for error group managing segments... Jul 28 00:08:56.847777761 (26h17m12.628711144s) [noise=true , address=77.90.31.10:4550 , piece_id=A6GUM4OQVM2CQBNOIRZQO7T3NAZJPGCDZRBFL5QONLA6GQKXBEYQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: <nil> Jul 28 00:08:56.890174982 (26h17m12.671108347s) [noise=true , address=79.127.219.38:4015 , piece_id=RQWP35OM7MIINZM2AEESJFVE3MWVO4VBYN2B5MVZSOJ34RKBGAIQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: <nil> Jul 28 00:08:57.119123514 (26h17m12.900056882s) [noise=true , address=79.127.201.215:4357 , piece_id=23PSCHERMHTKPKIFGYB5HENLZ7QTIT33NG5CXAVATAFCWP26BWSQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: <nil> Jul 28 00:08:57.834622991 (26h17m13.615556363s) [noise=true , address=64.49.13.138:4483 , piece_id=NSK6UUKSM3KYDYNFD2BQ2IS2BWV2A5G3LZJMUYBL7W2NX2HUKAGA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: <nil> Jul 28 00:09:42.170769316 (26h17m57.951702688s) [noise=true , address=104.36.82.36:4637 , piece_id=NNM2UYCFQ33RTIKKBQI33MAICSI6IGYSO5TE62X72YJQNEPFHQKA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: <nil> Jul 28 00:09:56.683654842 (26h18m12.464588209s) [noise=true , address=104.36.82.54:4177 , piece_id=TVUHZERMFYGDRCA6CIZFX5JCUWE55IZQOAC377BBER4EFAY3MBQA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG, address:104.36.82.54:4177): protocol: write tcp 159.223.143.39:48384->104.36.82.54:4177: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.683750837 (26h18m12.464684204s) [noise=true , address=104.36.82.10:4088 , piece_id=HWUY6AYKVUSK3YAG5AMNXU75YICROA3QJ6CGU5KWEGZKC43SNFNQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12QbJar7xfiCubCHQ4hTTG4UYNVrxQig1mpvBKeXoEBUzbCHsJT, address:104.36.82.10:4088): protocol: rpc: dial tcp 104.36.82.10:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.683809491 (26h18m12.46474286s) [noise=true , address=104.36.82.22:4543 , piece_id=LMULETYDL25GGECETR7BEEWKUQ6N2VJQY6ANXROQT3R3YIWMMXRQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:19iUYyo8cGDLGDnvdNo2Qfj1K6tp6EJWF5U6rXD4gJ7Hv7Gsch, address:104.36.82.22:4543): protocol: write tcp 159.223.143.39:50272->104.36.82.22:4543: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.683869039 (26h18m12.464802404s) [noise=true , address=104.36.82.44:4887 , piece_id=RCGSBE2AXABAW4Q75RYFA6RW3XDI4UUSROJ3GQE43AKVRQ3SAXSA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H, address:104.36.82.44:4887): protocol: write tcp 159.223.143.39:44434->104.36.82.44:4887: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.683921230 (26h18m12.464854595s) [noise=true , address=104.36.82.3:4796 , piece_id=G6K6YOWW2B5BHT6P5553VCJZJ22JTVQLCNHN7RXFKKJ3PDOD3QVQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12nZwQ4Poz9M14ijFV6qpy5SCWEMeyHQpxN17uSBTH1ts1CFtVS, address:104.36.82.3:4796): protocol: write tcp 159.223.143.39:55548->104.36.82.3:4796: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.683958766 (26h18m12.464892141s) [noise=true , address=104.36.82.41:4766 , piece_id=Z7QD5VZFYBW3EBBZPTJ4JI72XQSRVRAGRJP7PGWUNSBHYYXBWOGA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:1k6zdamuKPkBdzyNZNWx4FCmaTkv33PchcwvTRR8bgcETBs4K7, address:104.36.82.41:4766): protocol: write tcp 159.223.143.39:38280->104.36.82.41:4766: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684011054 (26h18m12.464944419s) [noise=true , address=104.36.82.55:4198 , piece_id=W553JQTZUK5UIQWMT5G45I2ZGIVA2SJM4OE54VWOQ3KY5UT4EFXQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:104.36.82.55:4198): protocol: write tcp 159.223.143.39:37892->104.36.82.55:4198: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684062968 (26h18m12.464996334s) [noise=true , address=104.36.82.9:4020 , piece_id=RAQPJMS2CPLJXE7X3KYNRM6NRR4OHJCJF7WMM6OT7HRO5RPZ3W4Q, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12XXPyMaA6o5DFhMTkkWf14bdqZoZ86MNjxzfSqvNU2KQj8xSyv, address:104.36.82.9:4020): protocol: write tcp 159.223.143.39:44466->104.36.82.9:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684096594 (26h18m12.465029963s) [noise=true , address=104.36.82.15:4269 , piece_id=CP57H4KDAY5OGPYA3BAUJKLGUXRYE6MONV3QUDZLJ27BVH56YT5Q, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:104.36.82.15:4269): protocol: write tcp 159.223.143.39:60580->104.36.82.15:4269: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684123660 (26h18m12.465057037s) [noise=true , address=104.36.82.53:4149 , piece_id=EWRYGOBKE456AWWWQJNR7NTUGHO6MLJ66RBYD2VRMO3LFX2PWSUA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:1nDCYjyLUqt1zkfotDNVcor73Cdpq3fnyMiygujdc9V4tGNHLY, address:104.36.82.53:4149): protocol: write tcp 159.223.143.39:58884->104.36.82.53:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684352514 (26h18m12.465285897s) [noise=true , address=104.36.82.47:4520 , piece_id=GHZKFDDKGWPRR6JFIGHE25AFHTJ6K4GPZHAWYINLEJDGCS76NMZQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, address:104.36.82.47:4520): protocol: write tcp 159.223.143.39:36770->104.36.82.47:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684368598 (26h18m12.465301965s) [noise=true , address=104.36.82.40:4961 , piece_id=DFI6BPZNX7QI6PJJJNYJPF6NVTZSGCCSM3SQG3Z2ZQHHPQPAECTQ, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:12ZGPLhM6NsdjKLkLCCLSeaNS8ikfnHPZxc3CCw9mLzSznbEoUa, address:104.36.82.40:4961): protocol: write tcp 159.223.143.39:39618->104.36.82.40:4961: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684433593 (26h18m12.465366969s) [noise=true , address=104.36.82.6:4893 , piece_id=PKXBYEFVAMDGE4PIUPODI3SZOY6Y5WYDKMPGVPHVWHQ74L2YGGLA, seg_pos={0 0}, upload=25094]: Done uploading piece. err: ecclient: upload failed (node:1259j7aHsLDMPtRwgXpd6u8axPEuaXzhRzqYYSgbpDnDqbhfwzi, address:104.36.82.6:4893): protocol: write tcp 159.223.143.39:52382->104.36.82.6:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:09:56.684466442 (26h18m12.465399807s) [seg_pos={0 0}, upload=25094]: Done waiting for segment. successful: 5 optimal: 14 errs: <nil> Jul 28 00:09:56.710126911 (26h18m12.49106028s) [upload=25094]: Done uploading segments... Jul 28 00:09:56.710175430 (26h18m12.491108799s) [upload=25094]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 5) Duration: 1m0.029152767s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 510.691289ms FAIL (2025-07-28 00:09:08 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 510.724489ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......................................................XXX.X] duration: 1m0.035761717s FAIL (2025-07-28 00:08:56 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.617687049 (26h16m12.398620431s) [noise=true , address=104.36.82.54:4186 , piece_id=QEK7AVYXFGA2K3SWXPBGOZD55PJHMBXLBF6VOYO4KI3WRWX726NA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.617974402 (26h16m12.398907787s) [noise=true , address=104.36.82.16:4312 , piece_id=6FA33XUZ3MTLONK7U7UTQVUSD7B224FDFGEDTQISNJYAGVM6XHRA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.618378233 (26h16m12.399311611s) [noise=true , address=104.36.82.13:4213 , piece_id=ESOZXRGGQPKCVSHKQTOTYYL2LS6GPSFPEX7BBHHISRFV6XQGQ6BQ, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.618753639 (26h16m12.399687017s) [noise=true , address=79.127.205.235:4682 , piece_id=XCG5FWV5FOQVPU7BILZ7YXB3V64FYBFQFE2M52AEHCDPKCFTJWTA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.619100727 (26h16m12.400034109s) [noise=true , address=104.36.82.42:4812 , piece_id=4TE674XREYJZMLWEYECZIZXDOXABGJQT3TBZUCTZYGW2QRIPD7QQ, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.619497876 (26h16m12.400431254s) [noise=true , address=104.36.82.5:4853 , piece_id=CQPN26N3LZBVBWJM4Q23RTPVFOFHOB3MZAYPBTFOU6E4KEY6RPUA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.619736823 (26h16m12.400670202s) [noise=true , address=77.90.31.16:4744 , piece_id=IJYYIZPT6FLEU7ZBWPJBSIN2CXKTLBFLWXHHXNKYEJTVM2PM6GAA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.620305930 (26h16m12.401239314s) [noise=true , address=104.36.82.10:4098 , piece_id=CPBIOKKZZ7ZQBHO6EGARMWCFWP544632IFUYTVTNFMWSQOM6QQVA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.620435706 (26h16m12.40136909s) [noise=true , address=79.127.205.245:4246 , piece_id=2STKYHBSHZWJ7YPQESKHR4IXOI6PZTBISLX4AFV4XGPZQTNSEKEQ, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.620793925 (26h16m12.401727319s) [noise=true , address=104.36.82.3:4786 , piece_id=T44SOB7NXUQUCSONRJHOQW56HGB2A7HR3KMXSGPKLJBV7ZU5V6OA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.620823554 (26h16m12.401756936s) [noise=true , address=104.36.82.15:4283 , piece_id=ZMBUUDW23YCSLBNL3PLDPIIJE5GYLNDIUQ2PKFAQPNQ3WZFRIOQA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.621176471 (26h16m12.40210985s) [noise=true , address=104.36.82.13:4220 , piece_id=QHXDURB3ITPF3SNL7ATAZHPZIOOTQTRVAH7EYMLDM7SFRW4FN35Q, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.621704234 (26h16m12.402637619s) [noise=true , address=104.36.82.12:4180 , piece_id=XS6DQJPYA6KO2S2RY7QRIDBAAKC4NNFRJ3OQ4FHYKA2CHQSM67DQ, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.623262359 (26h16m12.404195745s) [noise=true , address=104.36.82.47:4548 , piece_id=KBX6KPEELOGIUADTQC74TZ2CXAEYKAKBKQJIARAZCRDOR4P7R4MA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.623737793 (26h16m12.404671178s) [noise=true , address=104.36.82.54:4159 , piece_id=G3N6RFKIBMFOGNW7BIFK5GENV6FW27UKKXONAUTZVC76ZEGS5MLQ, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.624282888 (26h16m12.405216273s) [noise=true , address=104.36.82.41:4777 , piece_id=TRBGJXTHEXHGFZX7GO3U55ZRQESRYHVFDIC6IX3JD6LYCAH6HTCA, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.624675128 (26h16m12.405608513s) [noise=true , address=104.36.82.46:4494 , piece_id=SEH45Z6GCA3JRLXUVE3NI3ONTLVVOPEXBZHJTWRHMXJUPVA5FNLQ, seg_pos={0 0}, upload=25081]: Uploading piece... Jul 28 00:07:56.806287346 (26h16m12.58722071s) [upload=25081]: Next returned nil segment Jul 28 00:07:56.806308150 (26h16m12.587241537s) [upload=25081]: Waiting for error group managing segments... Jul 28 00:07:57.138266955 (26h16m12.919200331s) [noise=true , address=104.36.82.10:4098 , piece_id=CPBIOKKZZ7ZQBHO6EGARMWCFWP544632IFUYTVTNFMWSQOM6QQVA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:07:57.420424335 (26h16m13.201357714s) [noise=true , address=79.127.205.235:4682 , piece_id=XCG5FWV5FOQVPU7BILZ7YXB3V64FYBFQFE2M52AEHCDPKCFTJWTA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:07:57.868104539 (26h16m13.649037901s) [noise=true , address=79.127.205.245:4246 , piece_id=2STKYHBSHZWJ7YPQESKHR4IXOI6PZTBISLX4AFV4XGPZQTNSEKEQ, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:07:58.459245102 (26h16m14.240178475s) [noise=true , address=77.90.31.16:4744 , piece_id=IJYYIZPT6FLEU7ZBWPJBSIN2CXKTLBFLWXHHXNKYEJTVM2PM6GAA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:07:58.670730905 (26h16m14.451664266s) [noise=true , address=104.36.82.52:4118 , piece_id=HTTAY7GBUECVARGRG6YNCHC66NL56IJUVRK4VXEDO4BTABDMMV5A, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:07:59.302340412 (26h16m15.083273774s) [noise=true , address=104.36.82.3:4786 , piece_id=T44SOB7NXUQUCSONRJHOQW56HGB2A7HR3KMXSGPKLJBV7ZU5V6OA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:08:00.959013273 (26h16m16.739946641s) [noise=true , address=104.36.82.16:4312 , piece_id=6FA33XUZ3MTLONK7U7UTQVUSD7B224FDFGEDTQISNJYAGVM6XHRA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:08:02.581487413 (26h16m18.3624208s) [noise=true , address=104.36.82.5:4853 , piece_id=CQPN26N3LZBVBWJM4Q23RTPVFOFHOB3MZAYPBTFOU6E4KEY6RPUA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:08:10.604359460 (26h16m26.38529284s) [noise=true , address=104.36.82.12:4180 , piece_id=XS6DQJPYA6KO2S2RY7QRIDBAAKC4NNFRJ3OQ4FHYKA2CHQSM67DQ, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:08:11.110925759 (26h16m26.891859135s) [noise=true , address=104.36.82.15:4283 , piece_id=ZMBUUDW23YCSLBNL3PLDPIIJE5GYLNDIUQ2PKFAQPNQ3WZFRIOQA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:08:15.788338093 (26h16m31.569271471s) [noise=true , address=104.36.82.41:4777 , piece_id=TRBGJXTHEXHGFZX7GO3U55ZRQESRYHVFDIC6IX3JD6LYCAH6HTCA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: <nil> Jul 28 00:08:56.551842337 (26h17m12.332775703s) [noise=true , address=104.36.82.13:4213 , piece_id=ESOZXRGGQPKCVSHKQTOTYYL2LS6GPSFPEX7BBHHISRFV6XQGQ6BQ, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM, address:104.36.82.13:4213): protocol: write tcp 159.223.143.39:40940->104.36.82.13:4213: use of closed network connection; write tcp 159.223.143.39:40940->104.36.82.13:4213: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:40940->104.36.82.13:4213: use of closed network connection Jul 28 00:08:56.551927828 (26h17m12.332861215s) [noise=true , address=104.36.82.54:4186 , piece_id=QEK7AVYXFGA2K3SWXPBGOZD55PJHMBXLBF6VOYO4KI3WRWX726NA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T, address:104.36.82.54:4186): protocol: rpc: dial tcp 104.36.82.54:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:08:56.551998828 (26h17m12.33293221s) [noise=true , address=104.36.82.42:4812 , piece_id=4TE674XREYJZMLWEYECZIZXDOXABGJQT3TBZUCTZYGW2QRIPD7QQ, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:1TmXeVTeejZvrWi2RPxMutM6kXuZiMCtPxQBwL4tq6mhoLwFQo, address:104.36.82.42:4812): protocol: rpc: dial tcp 104.36.82.42:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:08:56.552074393 (26h17m12.333007763s) [noise=true , address=104.36.82.54:4159 , piece_id=G3N6RFKIBMFOGNW7BIFK5GENV6FW27UKKXONAUTZVC76ZEGS5MLQ, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA, address:104.36.82.54:4159): protocol: write tcp 159.223.143.39:44430->104.36.82.54:4159: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:08:56.552086053 (26h17m12.333019438s) [noise=true , address=104.36.82.13:4220 , piece_id=QHXDURB3ITPF3SNL7ATAZHPZIOOTQTRVAH7EYMLDM7SFRW4FN35Q, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6, address:104.36.82.13:4220): protocol: write tcp 159.223.143.39:43676->104.36.82.13:4220: use of closed network connection; write tcp 159.223.143.39:43676->104.36.82.13:4220: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:43676->104.36.82.13:4220: use of closed network connection Jul 28 00:08:56.552151112 (26h17m12.333084494s) [noise=true , address=104.36.82.46:4494 , piece_id=SEH45Z6GCA3JRLXUVE3NI3ONTLVVOPEXBZHJTWRHMXJUPVA5FNLQ, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:17b8LdpavJCCFXEBj7ndUKR6sge6Ntv96cGK5TmahF3MtwTV9z, address:104.36.82.46:4494): protocol: rpc: dial tcp 104.36.82.46:4494: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:08:56.552224539 (26h17m12.333157921s) [noise=true , address=104.36.82.47:4548 , piece_id=KBX6KPEELOGIUADTQC74TZ2CXAEYKAKBKQJIARAZCRDOR4P7R4MA, seg_pos={0 0}, upload=25081]: Done uploading piece. err: ecclient: upload failed (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT, address:104.36.82.47:4548): protocol: rpc: dial tcp 104.36.82.47:4548: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:08:56.552251249 (26h17m12.333184636s) [seg_pos={0 0}, upload=25081]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 28 00:08:56.584085423 (26h17m12.365018789s) [upload=25081]: Done uploading segments... Jul 28 00:08:56.584298404 (26h17m12.365231787s) [upload=25081]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.035789422s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 189.832247ms FAIL (2025-07-28 00:08:12 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 189.865105ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................................................XXX.] duration: 34.473753552s FAIL (2025-07-28 00:07:56 UTC) ======ERROR====== uplink: context deadline exceeded ======LOGS====== nline: false Jul 28 00:06:21.169435039 (26h14m36.950368407s) [upload=25053]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:06:21.169441703 (26h14m36.950375081s) [upload=25053]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:06:21.209462183 (26h14m36.99039557s) [seg_pos={0 0}, upload=25053]: Begin upload segment... Jul 28 00:06:21.209521674 (26h14m36.990455062s) [seg_pos={0 0}, upload=25053]: Done begin upload segment. Jul 28 00:06:21.209564428 (26h14m36.990497809s) [noise=true , address=104.36.82.55:4218 , piece_id=HSRIL2RA2Y4GRO3ETSKWPTRZDGGYK4AMMNH4IWG5JYNHCUSC4IJQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.210119377 (26h14m36.991052757s) [noise=true , address=79.127.201.215:4343 , piece_id=VNNHK4CEACPLYWK7QCEWOUJU6DSFVHXAPRQFXBWTAEP4CIVQU6WQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.210663053 (26h14m36.991596441s) [noise=true , address=104.36.82.6:4881 , piece_id=TZDD2L3XPYQAB2FGYXTLHWLPYB2CIV44KZUVDQUUNJU4K64QFWZA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.211218481 (26h14m36.992151862s) [noise=true , address=104.36.82.15:4277 , piece_id=PF3KLAANHN33KZ4QKXUZIQDK4OCWJBCGHDE3XR4PCTF7YYHSQ4OQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.211606767 (26h14m36.992540143s) [noise=true , address=104.36.82.13:4200 , piece_id=RHPAF7F3JC2ZOBQ5ZMHH3GP42QINHJC2KLQISXNWN7JAKAHMS3KA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.211985079 (26h14m36.992918461s) [noise=true , address=79.127.219.38:4002 , piece_id=JCSZBYUCM5GGFWPDSTYJ74HGGD42SA5BRQ3BCH4INBEAIOFD3HMA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.212545760 (26h14m36.993479149s) [noise=true , address=104.36.82.53:4152 , piece_id=6VDA2Z3VH2JAONI4H6SBAHW63BDEBKQTRBII7MAAX2S5NN4YXIZQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.212779954 (26h14m36.993713343s) [noise=true , address=104.36.82.10:4096 , piece_id=OPCIRQBNHT6WIPTWAINDMQRMSOM567TI4BHN7EOA4CZXQCZPK73Q, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.213219771 (26h14m36.994153153s) [noise=true , address=104.36.82.50:4019 , piece_id=XANO7LVNDDVWK7RZDEBN4BGCYOIVZGLG6CMBEH24RR2DBUOWXGGQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.213674928 (26h14m36.994608458s) [noise=true , address=104.36.82.22:4510 , piece_id=H3YF7RQ5WHYWV7K2SA2KGPEYNX4SXNPNZV7A5YUW434XHGYZ4SEQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.214141946 (26h14m36.995075325s) [noise=true , address=104.36.82.46:4493 , piece_id=6SVFZIJV7R364MN2FOB3BYZG3GQAQYURGBSRLSJ6TIUCNFXV5WZA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.214628210 (26h14m36.995561596s) [noise=true , address=104.36.82.54:4186 , piece_id=6UNRT7Z2PUK4T7XW6IY2R3XMKFS3PT7SAXEKKKQX2IKNQMLSDL5Q, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.215136095 (26h14m36.996069477s) [noise=true , address=104.36.82.11:4123 , piece_id=IF5T7SYON5OSGEQRWHZUZFKTEXBDLSM5TA4TQRET6SF3YV7DGEWA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.215577505 (26h14m36.996510894s) [noise=true , address=104.36.82.45:4926 , piece_id=EX5CYM2JEM7ICVGWLSZ3GRHR5SSO5BISNRV6O6554XJQLFGUUO5Q, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.216052542 (26h14m36.996985923s) [noise=true , address=104.36.82.12:4173 , piece_id=5U2LIQNV2OBIKARTE56XU2U5WZLZVAQ3JLZDVNMQWMQFQAXULECQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.216519990 (26h14m36.99745337s) [noise=true , address=104.36.82.7:4921 , piece_id=RKPWMFYUKC3CHR2RMHGBQML5MV32UQUSRRYVNWT3WPSBAFPVLBTA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.216964241 (26h14m36.997897623s) [noise=true , address=104.36.82.14:4233 , piece_id=JAHV55HKTGDJMS7VEBPOK2TCYJRXP2SXTRBQIAAAIWZ5Y6LEUDEA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.217411478 (26h14m36.998344856s) [noise=true , address=104.36.82.9:4029 , piece_id=MQJ4QGDWBTLZJBF5SZXR5VWD7QH34VUD2APHBMJAEE2QUSARKBJA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.304947976 (26h14m37.085881365s) [upload=25053]: Next returned nil segment Jul 28 00:06:21.304969356 (26h14m37.085902753s) [upload=25053]: Waiting for error group managing segments... Jul 28 00:06:21.412575470 (26h14m37.193508834s) [noise=true , address=104.36.82.11:4123 , piece_id=IF5T7SYON5OSGEQRWHZUZFKTEXBDLSM5TA4TQRET6SF3YV7DGEWA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:21.506433601 (26h14m37.287366965s) [noise=true , address=79.127.219.38:4002 , piece_id=JCSZBYUCM5GGFWPDSTYJ74HGGD42SA5BRQ3BCH4INBEAIOFD3HMA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:22.266371381 (26h14m38.047304767s) [noise=true , address=79.127.201.215:4343 , piece_id=VNNHK4CEACPLYWK7QCEWOUJU6DSFVHXAPRQFXBWTAEP4CIVQU6WQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.069564680 (26h14m42.850498051s) [noise=true , address=104.36.82.55:4218 , piece_id=HSRIL2RA2Y4GRO3ETSKWPTRZDGGYK4AMMNH4IWG5JYNHCUSC4IJQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.175778851 (26h14m42.956712225s) [noise=true , address=104.36.82.10:4096 , piece_id=OPCIRQBNHT6WIPTWAINDMQRMSOM567TI4BHN7EOA4CZXQCZPK73Q, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.369382405 (26h14m43.150315788s) [noise=true , address=104.36.82.14:4233 , piece_id=JAHV55HKTGDJMS7VEBPOK2TCYJRXP2SXTRBQIAAAIWZ5Y6LEUDEA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.788581868 (26h14m43.569515258s) [noise=true , address=104.36.82.50:4019 , piece_id=XANO7LVNDDVWK7RZDEBN4BGCYOIVZGLG6CMBEH24RR2DBUOWXGGQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.937890521 (26h14m43.718823884s) [noise=true , address=104.36.82.13:4200 , piece_id=RHPAF7F3JC2ZOBQ5ZMHH3GP42QINHJC2KLQISXNWN7JAKAHMS3KA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:29.326629364 (26h14m45.107562747s) [noise=true , address=104.36.82.45:4926 , piece_id=EX5CYM2JEM7ICVGWLSZ3GRHR5SSO5BISNRV6O6554XJQLFGUUO5Q, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:29.557234072 (26h14m45.33816744s) [noise=true , address=104.36.82.15:4277 , piece_id=PF3KLAANHN33KZ4QKXUZIQDK4OCWJBCGHDE3XR4PCTF7YYHSQ4OQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:32.254638689 (26h14m48.035572071s) [noise=true , address=104.36.82.22:4510 , piece_id=H3YF7RQ5WHYWV7K2SA2KGPEYNX4SXNPNZV7A5YUW434XHGYZ4SEQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:33.100515809 (26h14m48.881449174s) [noise=true , address=104.36.82.7:4921 , piece_id=RKPWMFYUKC3CHR2RMHGBQML5MV32UQUSRRYVNWT3WPSBAFPVLBTA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:33.210447647 (26h14m48.991381031s) [noise=true , address=104.36.82.6:4881 , piece_id=TZDD2L3XPYQAB2FGYXTLHWLPYB2CIV44KZUVDQUUNJU4K64QFWZA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:48.314888067 (26h15m4.095821447s) [noise=true , address=104.36.82.9:4029 , piece_id=MQJ4QGDWBTLZJBF5SZXR5VWD7QH34VUD2APHBMJAEE2QUSARKBJA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:48.314914921 (26h15m4.0958483s) [seg_pos={0 0}, upload=25053]: Segment reached optimal threshold of 14 pieces. Jul 28 00:06:48.315654997 (26h15m4.096588377s) [noise=true , address=104.36.82.54:4186 , piece_id=6UNRT7Z2PUK4T7XW6IY2R3XMKFS3PT7SAXEKKKQX2IKNQMLSDL5Q, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: read tcp 159.223.143.39:43194->104.36.82.54:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:48.315713038 (26h15m4.096646416s) [noise=true , address=104.36.82.12:4173 , piece_id=5U2LIQNV2OBIKARTE56XU2U5WZLZVAQ3JLZDVNMQWMQFQAXULECQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbGUhwH2eNqY75sLQCDgkvJ1QSrJ2n4Qg8A5Z73dFXxRpVwSC): protocol: write tcp 159.223.143.39:41088->104.36.82.12:4173: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:48.315817536 (26h15m4.096750905s) [noise=true , address=104.36.82.46:4493 , piece_id=6SVFZIJV7R364MN2FOB3BYZG3GQAQYURGBSRLSJ6TIUCNFXV5WZA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127drPYZWm7RRXuCLtuzDgSaxxuu3k1tg6eo3KWtrQGjBaUbfRJ): protocol: read tcp 159.223.143.39:41958->104.36.82.46:4493: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:48.315905275 (26h15m4.096838657s) [noise=true , address=104.36.82.53:4152 , piece_id=6VDA2Z3VH2JAONI4H6SBAHW63BDEBKQTRBII7MAAX2S5NN4YXIZQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127p3Fibbp6XQSewgrTiBAn45TSviFfjSGpv92tGLxsDSKWPuUe): protocol: read tcp 159.223.143.39:37218->104.36.82.53:4152: use of closed network connection; conn closed: op Jul 28 00:06:48.316047786 (26h15m4.096981179s) [seg_pos={0 0}, upload=25053]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 28 00:06:48.316397427 (26h15m4.097330808s) [upload=25053]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:06:48.316406631 (26h15m4.097340021s) [upload=25053]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:06:48.401632663 (26h15m4.182566052s) [upload=25053]: Done uploading segments... Jul 28 00:06:48.401680137 (26h15m4.182613518s) [upload=25053]: Upload finished. err: <nil> Duration: 34.473773323s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 219.885069ms FAIL (2025-07-28 00:07:40 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 220.000454ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.003028219s FAIL (2025-07-28 00:07:21 UTC) ======ERROR====== uplink: context deadline exceeded ======LOGS====== nline: false Jul 28 00:06:21.169435039 (26h14m36.950368407s) [upload=25053]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:06:21.169441703 (26h14m36.950375081s) [upload=25053]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:06:21.209462183 (26h14m36.99039557s) [seg_pos={0 0}, upload=25053]: Begin upload segment... Jul 28 00:06:21.209521674 (26h14m36.990455062s) [seg_pos={0 0}, upload=25053]: Done begin upload segment. Jul 28 00:06:21.209564428 (26h14m36.990497809s) [noise=true , address=104.36.82.55:4218 , piece_id=HSRIL2RA2Y4GRO3ETSKWPTRZDGGYK4AMMNH4IWG5JYNHCUSC4IJQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.210119377 (26h14m36.991052757s) [noise=true , address=79.127.201.215:4343 , piece_id=VNNHK4CEACPLYWK7QCEWOUJU6DSFVHXAPRQFXBWTAEP4CIVQU6WQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.210663053 (26h14m36.991596441s) [noise=true , address=104.36.82.6:4881 , piece_id=TZDD2L3XPYQAB2FGYXTLHWLPYB2CIV44KZUVDQUUNJU4K64QFWZA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.211218481 (26h14m36.992151862s) [noise=true , address=104.36.82.15:4277 , piece_id=PF3KLAANHN33KZ4QKXUZIQDK4OCWJBCGHDE3XR4PCTF7YYHSQ4OQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.211606767 (26h14m36.992540143s) [noise=true , address=104.36.82.13:4200 , piece_id=RHPAF7F3JC2ZOBQ5ZMHH3GP42QINHJC2KLQISXNWN7JAKAHMS3KA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.211985079 (26h14m36.992918461s) [noise=true , address=79.127.219.38:4002 , piece_id=JCSZBYUCM5GGFWPDSTYJ74HGGD42SA5BRQ3BCH4INBEAIOFD3HMA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.212545760 (26h14m36.993479149s) [noise=true , address=104.36.82.53:4152 , piece_id=6VDA2Z3VH2JAONI4H6SBAHW63BDEBKQTRBII7MAAX2S5NN4YXIZQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.212779954 (26h14m36.993713343s) [noise=true , address=104.36.82.10:4096 , piece_id=OPCIRQBNHT6WIPTWAINDMQRMSOM567TI4BHN7EOA4CZXQCZPK73Q, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.213219771 (26h14m36.994153153s) [noise=true , address=104.36.82.50:4019 , piece_id=XANO7LVNDDVWK7RZDEBN4BGCYOIVZGLG6CMBEH24RR2DBUOWXGGQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.213674928 (26h14m36.994608458s) [noise=true , address=104.36.82.22:4510 , piece_id=H3YF7RQ5WHYWV7K2SA2KGPEYNX4SXNPNZV7A5YUW434XHGYZ4SEQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.214141946 (26h14m36.995075325s) [noise=true , address=104.36.82.46:4493 , piece_id=6SVFZIJV7R364MN2FOB3BYZG3GQAQYURGBSRLSJ6TIUCNFXV5WZA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.214628210 (26h14m36.995561596s) [noise=true , address=104.36.82.54:4186 , piece_id=6UNRT7Z2PUK4T7XW6IY2R3XMKFS3PT7SAXEKKKQX2IKNQMLSDL5Q, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.215136095 (26h14m36.996069477s) [noise=true , address=104.36.82.11:4123 , piece_id=IF5T7SYON5OSGEQRWHZUZFKTEXBDLSM5TA4TQRET6SF3YV7DGEWA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.215577505 (26h14m36.996510894s) [noise=true , address=104.36.82.45:4926 , piece_id=EX5CYM2JEM7ICVGWLSZ3GRHR5SSO5BISNRV6O6554XJQLFGUUO5Q, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.216052542 (26h14m36.996985923s) [noise=true , address=104.36.82.12:4173 , piece_id=5U2LIQNV2OBIKARTE56XU2U5WZLZVAQ3JLZDVNMQWMQFQAXULECQ, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.216519990 (26h14m36.99745337s) [noise=true , address=104.36.82.7:4921 , piece_id=RKPWMFYUKC3CHR2RMHGBQML5MV32UQUSRRYVNWT3WPSBAFPVLBTA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.216964241 (26h14m36.997897623s) [noise=true , address=104.36.82.14:4233 , piece_id=JAHV55HKTGDJMS7VEBPOK2TCYJRXP2SXTRBQIAAAIWZ5Y6LEUDEA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.217411478 (26h14m36.998344856s) [noise=true , address=104.36.82.9:4029 , piece_id=MQJ4QGDWBTLZJBF5SZXR5VWD7QH34VUD2APHBMJAEE2QUSARKBJA, seg_pos={0 0}, upload=25053]: Uploading piece... Jul 28 00:06:21.304947976 (26h14m37.085881365s) [upload=25053]: Next returned nil segment Jul 28 00:06:21.304969356 (26h14m37.085902753s) [upload=25053]: Waiting for error group managing segments... Jul 28 00:06:21.412575470 (26h14m37.193508834s) [noise=true , address=104.36.82.11:4123 , piece_id=IF5T7SYON5OSGEQRWHZUZFKTEXBDLSM5TA4TQRET6SF3YV7DGEWA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:21.506433601 (26h14m37.287366965s) [noise=true , address=79.127.219.38:4002 , piece_id=JCSZBYUCM5GGFWPDSTYJ74HGGD42SA5BRQ3BCH4INBEAIOFD3HMA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:22.266371381 (26h14m38.047304767s) [noise=true , address=79.127.201.215:4343 , piece_id=VNNHK4CEACPLYWK7QCEWOUJU6DSFVHXAPRQFXBWTAEP4CIVQU6WQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.069564680 (26h14m42.850498051s) [noise=true , address=104.36.82.55:4218 , piece_id=HSRIL2RA2Y4GRO3ETSKWPTRZDGGYK4AMMNH4IWG5JYNHCUSC4IJQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.175778851 (26h14m42.956712225s) [noise=true , address=104.36.82.10:4096 , piece_id=OPCIRQBNHT6WIPTWAINDMQRMSOM567TI4BHN7EOA4CZXQCZPK73Q, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.369382405 (26h14m43.150315788s) [noise=true , address=104.36.82.14:4233 , piece_id=JAHV55HKTGDJMS7VEBPOK2TCYJRXP2SXTRBQIAAAIWZ5Y6LEUDEA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.788581868 (26h14m43.569515258s) [noise=true , address=104.36.82.50:4019 , piece_id=XANO7LVNDDVWK7RZDEBN4BGCYOIVZGLG6CMBEH24RR2DBUOWXGGQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:27.937890521 (26h14m43.718823884s) [noise=true , address=104.36.82.13:4200 , piece_id=RHPAF7F3JC2ZOBQ5ZMHH3GP42QINHJC2KLQISXNWN7JAKAHMS3KA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:29.326629364 (26h14m45.107562747s) [noise=true , address=104.36.82.45:4926 , piece_id=EX5CYM2JEM7ICVGWLSZ3GRHR5SSO5BISNRV6O6554XJQLFGUUO5Q, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:29.557234072 (26h14m45.33816744s) [noise=true , address=104.36.82.15:4277 , piece_id=PF3KLAANHN33KZ4QKXUZIQDK4OCWJBCGHDE3XR4PCTF7YYHSQ4OQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:32.254638689 (26h14m48.035572071s) [noise=true , address=104.36.82.22:4510 , piece_id=H3YF7RQ5WHYWV7K2SA2KGPEYNX4SXNPNZV7A5YUW434XHGYZ4SEQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:33.100515809 (26h14m48.881449174s) [noise=true , address=104.36.82.7:4921 , piece_id=RKPWMFYUKC3CHR2RMHGBQML5MV32UQUSRRYVNWT3WPSBAFPVLBTA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:33.210447647 (26h14m48.991381031s) [noise=true , address=104.36.82.6:4881 , piece_id=TZDD2L3XPYQAB2FGYXTLHWLPYB2CIV44KZUVDQUUNJU4K64QFWZA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:48.314888067 (26h15m4.095821447s) [noise=true , address=104.36.82.9:4029 , piece_id=MQJ4QGDWBTLZJBF5SZXR5VWD7QH34VUD2APHBMJAEE2QUSARKBJA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: <nil> Jul 28 00:06:48.314914921 (26h15m4.0958483s) [seg_pos={0 0}, upload=25053]: Segment reached optimal threshold of 14 pieces. Jul 28 00:06:48.315654997 (26h15m4.096588377s) [noise=true , address=104.36.82.54:4186 , piece_id=6UNRT7Z2PUK4T7XW6IY2R3XMKFS3PT7SAXEKKKQX2IKNQMLSDL5Q, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: read tcp 159.223.143.39:43194->104.36.82.54:4186: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:48.315713038 (26h15m4.096646416s) [noise=true , address=104.36.82.12:4173 , piece_id=5U2LIQNV2OBIKARTE56XU2U5WZLZVAQ3JLZDVNMQWMQFQAXULECQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbGUhwH2eNqY75sLQCDgkvJ1QSrJ2n4Qg8A5Z73dFXxRpVwSC): protocol: write tcp 159.223.143.39:41088->104.36.82.12:4173: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:48.315817536 (26h15m4.096750905s) [noise=true , address=104.36.82.46:4493 , piece_id=6SVFZIJV7R364MN2FOB3BYZG3GQAQYURGBSRLSJ6TIUCNFXV5WZA, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127drPYZWm7RRXuCLtuzDgSaxxuu3k1tg6eo3KWtrQGjBaUbfRJ): protocol: read tcp 159.223.143.39:41958->104.36.82.46:4493: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:48.315905275 (26h15m4.096838657s) [noise=true , address=104.36.82.53:4152 , piece_id=6VDA2Z3VH2JAONI4H6SBAHW63BDEBKQTRBII7MAAX2S5NN4YXIZQ, seg_pos={0 0}, upload=25053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127p3Fibbp6XQSewgrTiBAn45TSviFfjSGpv92tGLxsDSKWPuUe): protocol: read tcp 159.223.143.39:37218->104.36.82.53:4152: use of closed network connection; conn closed: op Jul 28 00:06:48.316047786 (26h15m4.096981179s) [seg_pos={0 0}, upload=25053]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 28 00:06:48.316397427 (26h15m4.097330808s) [upload=25053]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:06:48.316406631 (26h15m4.097340021s) [upload=25053]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:06:48.401632663 (26h15m4.182566052s) [upload=25053]: Done uploading segments... Jul 28 00:06:48.401680137 (26h15m4.182613518s) [upload=25053]: Upload finished. err: <nil> Duration: 1m0.003051848s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 214.208698ms FAIL (2025-07-28 00:06:29 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 214.244817ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.044128179s FAIL (2025-07-28 00:06:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== seg_pos={0 0}, upload=25038]: Begin upload segment... Jul 28 00:05:21.077878641 (26h13m36.858812022s) [seg_pos={0 0}, upload=25038]: Done begin upload segment. Jul 28 00:05:21.077915175 (26h13m36.858848561s) [noise=true , address=104.36.82.41:4782 , piece_id=4227IVJACVWROAFN5LMDKJC3JZCJAUYU7UCOUB5JSQOQQB57CEOA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.078435604 (26h13m36.859368994s) [noise=true , address=104.36.82.22:4523 , piece_id=AOB247SSV3PU64NIS5L2GPZP7J5JN2QWYRBR4YK4QGK7646N62YA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.078846221 (26h13m36.859779608s) [noise=true , address=104.36.82.43:4837 , piece_id=HIYOQV6WH2GFGIZZ4HAGVB7ZEZXOQUND4WXCINFZCRRRLYT34T6Q, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.079142172 (26h13m36.860075568s) [noise=true , address=79.127.201.215:4355 , piece_id=JLOPFVNIXNCEBAF32WLK3JXRP22OPJP67DENGDASK2725FKEMS2Q, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.079542552 (26h13m36.860475938s) [noise=true , address=104.36.82.47:4539 , piece_id=CUGH2UVOGJ5UVPKEW5CSVRNAFAD5LSLUYPER6ZO722U5E6EAPEWA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.079900739 (26h13m36.860834126s) [noise=true , address=104.36.82.14:4231 , piece_id=XZIQSCEW64JJK3P2I4RJWDWIRFZN2KUSAGOQ3DJNTYKMJCMXEZJQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.080410979 (26h13m36.861344365s) [noise=true , address=104.36.82.12:4159 , piece_id=Q5LWWLP4M2Q23G35DPXFNPLXOOIGNPK6QQVPL3U5OLGJBY5GY5HA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.080788073 (26h13m36.861721459s) [noise=true , address=104.36.82.5:4868 , piece_id=YINZQDNPDLKAEBEUDN5C3L3GNHRWYEVFISKFDSAY3EM3F5QACKBQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.081162385 (26h13m36.862095772s) [noise=true , address=104.36.82.10:4103 , piece_id=2R7XCBKSVIW7PZSGHGUT7OCGKLZJJFHNIBEUHZRERO47GB22YR6A, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.082777444 (26h13m36.863710832s) [noise=true , address=104.36.82.51:4075 , piece_id=2TM2PGHN3L5ZT44TMUYRXRZJUWRMJUJ34NZKNSDQTLBM37EZ7UHQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.083208106 (26h13m36.864141492s) [noise=true , address=104.36.82.53:4128 , piece_id=QRWEKHZBHYXVYWFHUXEI5TAXJWSOPNJK4RC5BW6ARUZUYMJTSLDA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.087442764 (26h13m36.868376152s) [noise=true , address=104.36.82.47:4525 , piece_id=ILHP72IJC6EP5VMGM3AUL3UDWKD2UXDEUFQMRKAOCAD5PDUBCMHQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.087926958 (26h13m36.86886034s) [noise=true , address=104.36.82.49:4001 , piece_id=I6FCIW54AOEZC4I2RH2JDS2RGPFGFC3IMOW34SL2YODQBSNVQMZQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.088520930 (26h13m36.869454321s) [noise=true , address=104.36.82.39:4732 , piece_id=5WFJWO3K2V4E2OXLQBTYPMP4RZVEQ7GY44S5IZDOM67HPB3KTWJA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.088935492 (26h13m36.869868873s) [noise=true , address=104.36.82.55:4203 , piece_id=VJU6L6JAUUGEACCIGHK7TUJCK5NADY3ODIRFQ4QLYFLASMGAKHKA, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.089322371 (26h13m36.870255753s) [noise=true , address=104.36.82.16:4299 , piece_id=OYF7VRX6YEDRRH6OJ7VWOLZR3F2XLBOON56JVCRQKZJ2GKHSLTJQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.089685756 (26h13m36.87061914s) [noise=true , address=104.36.82.54:4185 , piece_id=IBTWWA2X7GAXUG3A2BJFBEOTNL5MWH6HKICL25CI2DQSX2GLTN3A, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.090064459 (26h13m36.870997849s) [noise=true , address=104.36.82.56:4242 , piece_id=WGUII2ICBQZNTDHERR6ZZ27X2RRPFCAIWCVYFCWSX2HKKEDZYPNQ, seg_pos={0 0}, upload=25038]: Uploading piece... Jul 28 00:05:21.209232334 (26h13m36.990165707s) [upload=25038]: Next returned nil segment Jul 28 00:05:21.209272054 (26h13m36.990205444s) [upload=25038]: Waiting for error group managing segments... Jul 28 00:05:21.271327638 (26h13m37.052261008s) [noise=true , address=104.36.82.43:4837 , piece_id=HIYOQV6WH2GFGIZZ4HAGVB7ZEZXOQUND4WXCINFZCRRRLYT34T6Q, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:21.959522128 (26h13m37.740455495s) [noise=true , address=79.127.201.215:4355 , piece_id=JLOPFVNIXNCEBAF32WLK3JXRP22OPJP67DENGDASK2725FKEMS2Q, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:23.073347781 (26h13m38.854281166s) [noise=true , address=104.36.82.39:4732 , piece_id=5WFJWO3K2V4E2OXLQBTYPMP4RZVEQ7GY44S5IZDOM67HPB3KTWJA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:25.345253823 (26h13m41.126187189s) [noise=true , address=104.36.82.56:4242 , piece_id=WGUII2ICBQZNTDHERR6ZZ27X2RRPFCAIWCVYFCWSX2HKKEDZYPNQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:26.702814082 (26h13m42.483747444s) [noise=true , address=104.36.82.49:4001 , piece_id=I6FCIW54AOEZC4I2RH2JDS2RGPFGFC3IMOW34SL2YODQBSNVQMZQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:28.371648660 (26h13m44.152582038s) [noise=true , address=104.36.82.51:4075 , piece_id=2TM2PGHN3L5ZT44TMUYRXRZJUWRMJUJ34NZKNSDQTLBM37EZ7UHQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:32.245176111 (26h13m48.026109478s) [noise=true , address=104.36.82.12:4159 , piece_id=Q5LWWLP4M2Q23G35DPXFNPLXOOIGNPK6QQVPL3U5OLGJBY5GY5HA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:35.789543813 (26h13m51.570477196s) [noise=true , address=104.36.82.16:4299 , piece_id=OYF7VRX6YEDRRH6OJ7VWOLZR3F2XLBOON56JVCRQKZJ2GKHSLTJQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:36.088503027 (26h13m51.869436392s) [noise=true , address=104.36.82.5:4868 , piece_id=YINZQDNPDLKAEBEUDN5C3L3GNHRWYEVFISKFDSAY3EM3F5QACKBQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:43.556727901 (26h13m59.337661285s) [noise=true , address=104.36.82.41:4782 , piece_id=4227IVJACVWROAFN5LMDKJC3JZCJAUYU7UCOUB5JSQOQQB57CEOA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:44.859693665 (26h14m0.640627035s) [noise=true , address=104.36.82.22:4523 , piece_id=AOB247SSV3PU64NIS5L2GPZP7J5JN2QWYRBR4YK4QGK7646N62YA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:05:57.647697447 (26h14m13.42863085s) [noise=true , address=104.36.82.10:4103 , piece_id=2R7XCBKSVIW7PZSGHGUT7OCGKLZJJFHNIBEUHZRERO47GB22YR6A, seg_pos={0 0}, upload=25038]: Done uploading piece. err: <nil> Jul 28 00:06:21.000735975 (26h14m36.781669392s) [noise=true , address=104.36.82.14:4231 , piece_id=XZIQSCEW64JJK3P2I4RJWDWIRFZN2KUSAGOQ3DJNTYKMJCMXEZJQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: ecclient: upload failed (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ, address:104.36.82.14:4231): protocol: write tcp 159.223.143.39:50306->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:50306->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50306->104.36.82.14:4231: use of closed network connection Jul 28 00:06:21.001001178 (26h14m36.781934558s) [noise=true , address=104.36.82.55:4203 , piece_id=VJU6L6JAUUGEACCIGHK7TUJCK5NADY3ODIRFQ4QLYFLASMGAKHKA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: ecclient: upload failed (node:12ZewP4Cfpax2814Hqbtfvp4PzcDX455Gv7WwSTSwt1NTMXzYhU, address:104.36.82.55:4203): protocol: rpc: dial tcp 104.36.82.55:4203: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:21.001115471 (26h14m36.78204885s) [noise=true , address=104.36.82.53:4128 , piece_id=QRWEKHZBHYXVYWFHUXEI5TAXJWSOPNJK4RC5BW6ARUZUYMJTSLDA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: ecclient: upload failed (node:125ZMc6ed9qgBRtBC5N4zNvGonip3GNAEBPt3auF6dBGteX46Pf, address:104.36.82.53:4128): protocol: write tcp 159.223.143.39:41446->104.36.82.53:4128: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:21.001175805 (26h14m36.782109185s) [noise=true , address=104.36.82.47:4525 , piece_id=ILHP72IJC6EP5VMGM3AUL3UDWKD2UXDEUFQMRKAOCAD5PDUBCMHQ, seg_pos={0 0}, upload=25038]: Done uploading piece. err: ecclient: upload failed (node:1hRLixZtY6GptLU6MgGZAvnk4YvuDD6WbBFUePZSndN9UbpHhX, address:104.36.82.47:4525): protocol: write tcp 159.223.143.39:52866->104.36.82.47:4525: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:21.001359102 (26h14m36.782292498s) [noise=true , address=104.36.82.47:4539 , piece_id=CUGH2UVOGJ5UVPKEW5CSVRNAFAD5LSLUYPER6ZO722U5E6EAPEWA, seg_pos={0 0}, upload=25038]: Done uploading piece. err: ecclient: upload failed (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ, address:104.36.82.47:4539): protocol: rpc: dial tcp 104.36.82.47:4539: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:21.001428798 (26h14m36.782362184s) [noise=true , address=104.36.82.54:4185 , piece_id=IBTWWA2X7GAXUG3A2BJFBEOTNL5MWH6HKICL25CI2DQSX2GLTN3A, seg_pos={0 0}, upload=25038]: Done uploading piece. err: ecclient: upload failed (node:1cLdyyVLrp1yBmgsfBrfYc6N2RFbBichYoBbo2F7EZfaBXtkfk, address:104.36.82.54:4185): protocol: read tcp 159.223.143.39:36292->104.36.82.54:4185: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:06:21.001481903 (26h14m36.782415292s) [seg_pos={0 0}, upload=25038]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 28 00:06:21.039986377 (26h14m36.8209198s) [upload=25038]: Done uploading segments... Jul 28 00:06:21.040018459 (26h14m36.820951849s) [upload=25038]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.044150775s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 464.273188ms FAIL (2025-07-28 00:05:23 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 464.300973ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003925903s FAIL (2025-07-28 00:05:20 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== d=25027]: Got next segment. Inline: false Jul 28 00:04:20.935320225 (26h12m36.716253599s) [upload=25027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 28 00:04:20.935327000 (26h12m36.716260383s) [upload=25027]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 28 00:04:20.975382199 (26h12m36.756315585s) [seg_pos={0 0}, upload=25027]: Begin upload segment... Jul 28 00:04:20.975456701 (26h12m36.756390062s) [seg_pos={0 0}, upload=25027]: Done begin upload segment. Jul 28 00:04:20.975525401 (26h12m36.756458787s) [noise=true , address=64.49.13.140:4508 , piece_id=GZSYWJ5OLUXEJ3U3TCOC6ZRGTS3BQMJCAWDJJX2KGEUHOMNUK7RA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.975536916 (26h12m36.756470296s) [noise=true , address=104.36.82.40:4953 , piece_id=DA6X3GQLFOTSSJLGRZ5A2L4VHFG4J5JRTKC2LTC3HYETISVOGS6Q, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.976389487 (26h12m36.757322872s) [noise=true , address=104.36.82.44:4890 , piece_id=QC74GPJBHLWGXJKOWBR4HO4ZNS36XFK5VTHAIWQRXWREQCE2IZIA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.977808986 (26h12m36.758742371s) [noise=true , address=104.36.82.53:4121 , piece_id=KVFCDLQUJCEWCJNERI7HWQHCKUMACONIPFPZQSMDYCHCDXITL4QQ, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.978259569 (26h12m36.759192956s) [noise=true , address=104.36.82.51:4057 , piece_id=5YUG56H2BFJCRE6AR5U4FDMN2LQIKSCCFCPPBLYS5KA34Y5KRVIA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.978583635 (26h12m36.759517s) [noise=true , address=79.127.219.51:4187 , piece_id=NYC7N5PNB73BUOMAONFEY4FS742F3Z4RQGU4H7EUBAVBGJ5BUJAQ, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.978912636 (26h12m36.759846013s) [noise=true , address=79.127.201.215:4357 , piece_id=RJBLYFV3MPGK2L7EAQKEOQ65VWBPB5WNCITTWUBZY4EERGLDS7RA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.979218960 (26h12m36.760152343s) [noise=true , address=104.36.82.54:4187 , piece_id=CLKD5FBITLPW4KRX6EISNM2YAW4NILHPBUSBQC2UKI4U3JYJNDWQ, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.979612125 (26h12m36.760545509s) [noise=true , address=104.36.82.50:4018 , piece_id=2F5EAWUAE3RI36JU4UZHAZN7OWK7JFO5OKXXASJPOFA52VFNSQBQ, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.979935354 (26h12m36.760868735s) [noise=true , address=104.36.82.42:4810 , piece_id=PT2VYANPDG3COP3P36KVQSNGBRBFLR7RQ2DKQJZ5NDYHLCP7MRYA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.980420397 (26h12m36.76135378s) [noise=true , address=104.36.82.56:4263 , piece_id=ZVAXUEU5NAIBEJMOQYUXIZFAQGTEXUKUYAUQTMUTUESCWA37R43Q, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.980792771 (26h12m36.761726139s) [noise=true , address=104.36.82.10:4105 , piece_id=Q6EIXY6JUSU6DR7LDTVU3CKVZ4COGK6SH6Z7AQTFIJKAOZ5WWARA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.987508378 (26h12m36.768441744s) [noise=true , address=104.36.82.52:4093 , piece_id=E2MKFDX4YK3TZZTMY5VI2NAMS63UQRXOBP2GRDKLLZIG5KAU63TA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.988804823 (26h12m36.769738207s) [noise=true , address=104.36.82.11:4144 , piece_id=EBHUTG3ZT5VBILKTJA6Z76DFEHEKIRT6XPTOZTKY4YTEPKJRYGWA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.989585404 (26h12m36.770518789s) [noise=true , address=104.36.82.14:4236 , piece_id=2E7VWGX5UXMTKZ5R7OAUQM5HLOCK7UTKETA3IL24RXTDQYSNFFYA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.990301111 (26h12m36.771234477s) [noise=true , address=104.36.82.55:4214 , piece_id=BB7ESTQBLAE6YIPSAGVPM6POZO7PTXD7B42T3SR7D3RRRUZUMHBA, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.991062523 (26h12m36.771995907s) [noise=true , address=104.36.82.6:4903 , piece_id=HUIGVCVQXO2GK6L6HV6TLNYBZ3B5GBP7CUFXM7IH4IHGPUOBPBHQ, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:20.991796578 (26h12m36.772729966s) [noise=true , address=79.127.205.234:4585 , piece_id=AGBBD5PSDDLPTL6TZU6NSE56RIDTNTZMMYHN2O6AYFAERSMTDTTQ, seg_pos={0 0}, upload=25027]: Uploading piece... Jul 28 00:04:21.081162550 (26h12m36.862095934s) [upload=25027]: Next returned nil segment Jul 28 00:04:21.081183960 (26h12m36.862117347s) [upload=25027]: Waiting for error group managing segments... Jul 28 00:04:21.104682153 (26h12m36.885615535s) [noise=true , address=104.36.82.50:4018 , piece_id=2F5EAWUAE3RI36JU4UZHAZN7OWK7JFO5OKXXASJPOFA52VFNSQBQ, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:21.107197570 (26h12m36.888130948s) [noise=true , address=104.36.82.44:4890 , piece_id=QC74GPJBHLWGXJKOWBR4HO4ZNS36XFK5VTHAIWQRXWREQCE2IZIA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:21.291415207 (26h12m37.072348586s) [noise=true , address=79.127.219.51:4187 , piece_id=NYC7N5PNB73BUOMAONFEY4FS742F3Z4RQGU4H7EUBAVBGJ5BUJAQ, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:21.545579938 (26h12m37.326513318s) [noise=true , address=79.127.201.215:4357 , piece_id=RJBLYFV3MPGK2L7EAQKEOQ65VWBPB5WNCITTWUBZY4EERGLDS7RA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:21.747872902 (26h12m37.528806263s) [noise=true , address=64.49.13.140:4508 , piece_id=GZSYWJ5OLUXEJ3U3TCOC6ZRGTS3BQMJCAWDJJX2KGEUHOMNUK7RA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:21.789620300 (26h12m37.57055368s) [noise=true , address=79.127.205.234:4585 , piece_id=AGBBD5PSDDLPTL6TZU6NSE56RIDTNTZMMYHN2O6AYFAERSMTDTTQ, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:22.279821373 (26h12m38.060754743s) [noise=true , address=104.36.82.10:4105 , piece_id=Q6EIXY6JUSU6DR7LDTVU3CKVZ4COGK6SH6Z7AQTFIJKAOZ5WWARA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:22.310439086 (26h12m38.091372453s) [noise=true , address=104.36.82.51:4057 , piece_id=5YUG56H2BFJCRE6AR5U4FDMN2LQIKSCCFCPPBLYS5KA34Y5KRVIA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:24.621345237 (26h12m40.402278617s) [noise=true , address=104.36.82.6:4903 , piece_id=HUIGVCVQXO2GK6L6HV6TLNYBZ3B5GBP7CUFXM7IH4IHGPUOBPBHQ, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:26.041264594 (26h12m41.822197972s) [noise=true , address=104.36.82.11:4144 , piece_id=EBHUTG3ZT5VBILKTJA6Z76DFEHEKIRT6XPTOZTKY4YTEPKJRYGWA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:27.831202268 (26h12m43.61213563s) [noise=true , address=104.36.82.54:4187 , piece_id=CLKD5FBITLPW4KRX6EISNM2YAW4NILHPBUSBQC2UKI4U3JYJNDWQ, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:27.993391369 (26h12m43.774324758s) [noise=true , address=104.36.82.56:4263 , piece_id=ZVAXUEU5NAIBEJMOQYUXIZFAQGTEXUKUYAUQTMUTUESCWA37R43Q, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:29.211719734 (26h12m44.992653118s) [noise=true , address=104.36.82.42:4810 , piece_id=PT2VYANPDG3COP3P36KVQSNGBRBFLR7RQ2DKQJZ5NDYHLCP7MRYA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:29.304851190 (26h12m45.08578457s) [noise=true , address=104.36.82.40:4953 , piece_id=DA6X3GQLFOTSSJLGRZ5A2L4VHFG4J5JRTKC2LTC3HYETISVOGS6Q, seg_pos={0 0}, upload=25027]: Done uploading piece. err: <nil> Jul 28 00:04:29.304892241 (26h12m45.08582562s) [seg_pos={0 0}, upload=25027]: Segment reached optimal threshold of 14 pieces. Jul 28 00:04:29.305750795 (26h12m45.086684162s) [noise=true , address=104.36.82.53:4121 , piece_id=KVFCDLQUJCEWCJNERI7HWQHCKUMACONIPFPZQSMDYCHCDXITL4QQ, seg_pos={0 0}, upload=25027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: rpc: dial tcp 104.36.82.53:4121: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:04:29.305827657 (26h12m45.086761033s) [noise=true , address=104.36.82.14:4236 , piece_id=2E7VWGX5UXMTKZ5R7OAUQM5HLOCK7UTKETA3IL24RXTDQYSNFFYA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: rpc: dial tcp 104.36.82.14:4236: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:04:29.305890066 (26h12m45.086823443s) [noise=true , address=104.36.82.52:4093 , piece_id=E2MKFDX4YK3TZZTMY5VI2NAMS63UQRXOBP2GRDKLLZIG5KAU63TA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APDQdo9gz4mqC7TxxZE6zbf92LLP26iUYfpcpri4LyQn2ic4E): protocol: rpc: dial tcp 104.36.82.52:4093: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:04:29.305955684 (26h12m45.086889063s) [noise=true , address=104.36.82.55:4214 , piece_id=BB7ESTQBLAE6YIPSAGVPM6POZO7PTXD7B42T3SR7D3RRRUZUMHBA, seg_pos={0 0}, upload=25027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LV4vwjXQvjzxs1jtSpNXZ6VvzLXbQBCYQBn5gzb7jh2DD9qpi): protocol: write tcp 159.223.143.39:53246->104.36.82.55:4214: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 28 00:04:29.305969359 (26h12m45.08690274s) [seg_pos={0 0}, upload=25027]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 28 00:04:29.306059357 (26h12m45.08699274s) [upload=25027]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 28 00:04:29.306065039 (26h12m45.086998419s) [upload=25027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 28 00:04:29.382792999 (26h12m45.163726378s) [upload=25027]: Done uploading segments... Jul 28 00:04:29.382815450 (26h12m45.163748828s) [upload=25027]: Upload finished. err: <nil> Duration: 1m0.003954028s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 206.468678ms FAIL (2025-07-28 00:04:11 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 206.504135ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 232.846531ms FAIL (2025-07-28 00:03:41 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 232.88823ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 263.244333ms FAIL (2025-07-28 00:02:31 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 263.273556ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 191.224882ms FAIL (2025-07-28 00:02:04 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 191.255082ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 502.816261ms FAIL (2025-07-28 00:01:44 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 502.858127ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 270.448654ms FAIL (2025-07-28 00:00:41 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 270.488706ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 301.687103ms FAIL (2025-07-28 00:00:00 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 301.793644ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 212.707055ms FAIL (2025-07-27 23:59:30 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 212.73995ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 219.218804ms FAIL (2025-07-27 23:59:08 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 219.24649ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 205.927233ms FAIL (2025-07-27 23:58:21 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 205.975359ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 189.317791ms FAIL (2025-07-27 23:57:53 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 189.346433ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 304.283432ms FAIL (2025-07-27 23:56:42 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 304.329958ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 315.095811ms FAIL (2025-07-27 23:55:55 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 315.139165ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 196.735988ms FAIL (2025-07-27 23:55:26 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 196.778097ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 247.02506ms FAIL (2025-07-27 23:54:43 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 247.051667ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 287.125048ms FAIL (2025-07-27 23:54:02 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 287.175668ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 201.091597ms FAIL (2025-07-27 23:53:24 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 201.126129ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 266.953543ms FAIL (2025-07-27 23:53:04 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 266.987752ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.......................................................X...] duration: 268.036706ms FAIL (2025-07-27 23:52:16 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 268.079539ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.......................................................X..] duration: 1.514011713s FAIL (2025-07-27 23:52:02 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.514060458s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X.......................................................X.] duration: 274.905494ms FAIL (2025-07-27 23:51:40 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 274.957536ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X.......................................................X] duration: 222.605669ms FAIL (2025-07-27 23:51:09 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 222.633736ms core uplink us1 vivint

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)