Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........X.....X....X..X..................................] duration: 1.577843633s FAIL (2025-07-21 23:30:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.57787606s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.413183722s FAIL (2025-07-21 23:30:03 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 1.413224985s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.591540015s FAIL (2025-07-21 23:29:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 1.59156283s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............X.....X....X..X.................................] duration: 28.774130041s FAIL (2025-07-21 23:29:34 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.774155322s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 817.808864ms FAIL (2025-07-21 23:28:59 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 817.842034ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 3.505413641s FAIL (2025-07-21 23:28:36 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 3.505436695s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............X.....X....X..X................................] duration: 719.229669ms FAIL (2025-07-21 23:28:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 720.108545ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 446.190684ms FAIL (2025-07-21 23:28:01 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 446.225147ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............X.....X....X..X...............................] duration: 1.229704591s FAIL (2025-07-21 23:27:19 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.229731904s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............X.....X....X..X..............................] duration: 9.261796735s FAIL (2025-07-21 23:27:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.261828167s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 8.863257977s FAIL (2025-07-21 23:27:08 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 8.863307485s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................X.....X....X..X.............................] duration: 1.23569941s FAIL (2025-07-21 23:26:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.235719736s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................X.....X....X..X............................] duration: 651.372499ms FAIL (2025-07-21 23:26:31 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 651.427671ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.955995603s FAIL (2025-07-21 23:26:22 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 4.956027431s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..................X.....X....X..X...........................] duration: 46.70980117s FAIL (2025-07-21 23:26:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 46.710014159s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 3.637902698s FAIL (2025-07-21 23:26:00 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 3.637930132s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.449002672s FAIL (2025-07-21 23:25:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 1.44902918s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 803.580203ms FAIL (2025-07-21 23:24:52 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 803.626906ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................X.....X....X..X..........................] duration: 6.914868897s FAIL (2025-07-21 23:24:46 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.914894773s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.444813471s FAIL (2025-07-21 23:24:37 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 1.444872081s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................X.....X....X..X.........................] duration: 5.680465461s FAIL (2025-07-21 23:24:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.68049449s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 827.237631ms FAIL (2025-07-21 23:24:10 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 827.269962ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.....X....X..X........................] duration: 6.421406051s FAIL (2025-07-21 23:23:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.421495139s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 492.058408ms FAIL (2025-07-21 23:23:01 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 492.085408ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......................X.....X....X..X.......................] duration: 21.530723371s FAIL (2025-07-21 23:22:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.530753203s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.350763341s FAIL (2025-07-21 23:22:02 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 1.3507977s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 498.973667ms FAIL (2025-07-21 23:21:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 499.001601ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.....X....X..X......................] duration: 11.441742209s FAIL (2025-07-21 23:21:28 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.441772254s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.274220734s FAIL (2025-07-21 23:21:06 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 2.274252105s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................X.....X....X..X.....................] duration: 1.137707376s FAIL (2025-07-21 23:20:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.137736856s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 639.694154ms FAIL (2025-07-21 23:20:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 639.722317ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 601.320619ms FAIL (2025-07-21 23:19:59 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 601.386472ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.....X....X..X....................] duration: 1.01413855s FAIL (2025-07-21 23:19:53 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.014243888s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 834.579435ms FAIL (2025-07-21 23:19:30 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 834.609144ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 17.350453816s FAIL (2025-07-21 23:19:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 17.350485728s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.406309152s FAIL (2025-07-21 23:18:52 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 4.406330004s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.003639456s FAIL (2025-07-21 23:18:47 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: write tcp 159.223.143.39:45270->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:17:24.165004211 (72h27m6.013611298s) [seg_pos={0 0}, upload=57949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:17:24.165120348 (72h27m6.013727437s) [upload=57949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:17:24.165126833 (72h27m6.013733917s) [upload=57949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:17:24.212200709 (72h27m6.060807788s) [upload=57949]: Done uploading segments... Jul 21 23:17:24.212223698 (72h27m6.060830779s) [upload=57949]: Upload finished. err: <nil> Jul 21 23:18:17.656177722 (72h27m59.504784801s) [upload=57962]: Starting upload Jul 21 23:18:17.656257051 (72h27m59.504864134s) [upload=57962]: Done starting upload Jul 21 23:18:17.656517180 (72h27m59.505124252s) [upload=57962]: Uploading segments... Jul 21 23:18:17.656648005 (72h27m59.505255091s) [upload=57962]: Got next segment. Inline: false Jul 21 23:18:17.656730310 (72h27m59.505337381s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 21 23:18:17.656755643 (72h27m59.505362732s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 21 23:18:17.688469593 (72h27m59.537076677s) [seg_pos={0 0}, upload=57962]: Begin upload segment... Jul 21 23:18:17.688525948 (72h27m59.537133018s) [seg_pos={0 0}, upload=57962]: Done begin upload segment. Jul 21 23:18:17.688554683 (72h27m59.53716178s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.688567851 (72h27m59.537174942s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689009443 (72h27m59.537616529s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689160244 (72h27m59.537767326s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689433427 (72h27m59.538040502s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689720722 (72h27m59.538327803s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.689914229 (72h27m59.538521313s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690190143 (72h27m59.538797225s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690301325 (72h27m59.538908411s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690627802 (72h27m59.5392349s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690668175 (72h27m59.53927526s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.690952592 (72h27m59.539559677s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691126121 (72h27m59.539733203s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691329514 (72h27m59.539936601s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691589223 (72h27m59.540196305s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.691703336 (72h27m59.54031042s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Uploading piece... Jul 21 23:18:17.774337466 (72h27m59.622944538s) [upload=57962]: Next returned nil segment Jul 21 23:18:17.774357849 (72h27m59.622964934s) [upload=57962]: Waiting for error group managing segments... Jul 21 23:18:17.782297334 (72h27m59.630904403s) [noise=true , address=45.91.116.10:4081 , piece_id=QGWABLQFXH4BCY6VLIVRFPX6EIVIGYN5W4YM4HNZV472DJNJWAYA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.782803757 (72h27m59.631410828s) [noise=true , address=45.91.116.10:4082 , piece_id=U7FCZHMVO5LCXCBK4PQAIL6A5JC2JLZT2W4FITHBUL57QCHDQOWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:17.807443161 (72h27m59.656050239s) [noise=true , address=45.91.116.14:4189 , piece_id=ENMR47FPTQWQZQBWENXIDYMML3JMWZT7OQPLQ5XIYW2OFE25JTFA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:18.754331863 (72h28m0.602938929s) [noise=true , address=45.91.116.6:4974 , piece_id=D2U3FO6SP3Y23VVK23E7HPID4ATW7IF5WTEJWYJXIXECMQ76Z42Q, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:19.875439965 (72h28m1.724047036s) [noise=true , address=104.36.82.8:4972 , piece_id=RFC45ZPOE4N7EIPUJD4OWQF6LWRC4U23VGXPIDPUZO4P5RLYIEDQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:22.232185161 (72h28m4.080792241s) [noise=true , address=104.36.82.10:4077 , piece_id=DGU7NRUSSW76MVRTT4B56PK6ZJXJ56IQAHZPRV77TYYKX3XFIHZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.127197806 (72h28m6.975804875s) [noise=true , address=104.36.82.6:4875 , piece_id=NIUN4M3U4PL44TP2SZLPUM3M5WGJYQVPAQKWKWERC3SJHPCARZZA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:25.352395099 (72h28m7.201002177s) [noise=true , address=104.36.82.14:4223 , piece_id=6F5AHVOCOLRSPAFXL7BVRLAHBJ2WGTVR3RS5W4ZOHARLZJPDSJSQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:29.802237912 (72h28m11.650845006s) [noise=true , address=104.36.82.15:4259 , piece_id=FC32OQ7L2TVXDFGEIUJ5KEI57MTVB5RB5IRRVPW6SGTWAHSOOPOA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:32.623147661 (72h28m14.471754735s) [noise=true , address=104.36.82.3:4767 , piece_id=ZL72TANQJVRKYLUYGQPAX7DNGGKD3TTBY5HS6Q7SEX6DU6KJK3TQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:38.504797891 (72h28m20.353404969s) [noise=true , address=104.36.82.16:4293 , piece_id=3KK3I7A3DBZRXIRYWAXJJKRG7TH6LGSKUTQSEGFGX35X5A7OAMCA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:40.260235005 (72h28m22.108842072s) [noise=true , address=104.36.82.16:4295 , piece_id=IMVZ4O3RFMW2QAGGKIJ6DJ6DUDA6ADBUT5FHHUZDPJU75TI6U5UQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979948314 (72h28m25.828555395s) [noise=true , address=104.36.82.9:4005 , piece_id=D64RV2XL6QVUDBMNXEU7NAJ6VHTK5CRY47B2WKWLN6RAJMHSCJWA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: <nil> Jul 21 23:18:43.979982630 (72h28m25.828589711s) [seg_pos={0 0}, upload=57962]: Segment reached optimal threshold of 13 pieces. Jul 21 23:18:43.980515951 (72h28m25.829123035s) [noise=true , address=104.36.82.5:4840 , piece_id=3XVG5NOLOCHDLWNC7GKPAJ4EZL7M26ENZW34KLJGZ5NRJGMVYP2A, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: rpc: dial tcp 104.36.82.5:4840: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980555334 (72h28m25.829162419s) [noise=true , address=104.36.82.5:4837 , piece_id=66XZNWE3RXNILN65IMNX5X7TQYCKF6QXJDFGUUIOYAYS2GQC3SJQ, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 159.223.143.39:35166->104.36.82.5:4837: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980603676 (72h28m25.829210767s) [noise=true , address=104.36.82.12:4149 , piece_id=O3SWGMZ6S4SZQEGI3MXB7JVKHBJRKAQFXOKNII37VHO4BSGGLFXA, seg_pos={0 0}, upload=57962]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 159.223.143.39:59214->104.36.82.12:4149: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 21 23:18:43.980622868 (72h28m25.82922994s) [seg_pos={0 0}, upload=57962]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 21 23:18:43.980694561 (72h28m25.829301646s) [upload=57962]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 21 23:18:43.980699451 (72h28m25.829306525s) [upload=57962]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 21 23:18:44.029370168 (72h28m25.877977237s) [upload=57962]: Done uploading segments... Jul 21 23:18:44.029388033 (72h28m25.877995113s) [upload=57962]: Upload finished. err: <nil> Duration: 30.003671668s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.....X....X..X...................] duration: 7.606226457s FAIL (2025-07-21 23:18:45 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.606258368s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.....X....X..X..................] duration: 6.486925329s FAIL (2025-07-21 23:18:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.486957272s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............................X.....X....X..X.................] duration: 13.851597721s FAIL (2025-07-21 23:17:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.851649715s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............................X.....X....X..X................] duration: 10.670733376s FAIL (2025-07-21 23:17:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.670760897s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............................X.....X....X..X...............] duration: 3.803724767s FAIL (2025-07-21 23:16:40 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.803754864s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............................X.....X....X..X..............] duration: 6.893613238s FAIL (2025-07-21 23:16:17 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.893630976s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................................X.....X....X..X.............] duration: 32.772999878s FAIL (2025-07-21 23:16:10 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 32.7730288s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................................X.....X....X..X............] duration: 947.651348ms FAIL (2025-07-21 23:14:43 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 947.676339ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..................................X.....X....X..X...........] duration: 18.544795088s FAIL (2025-07-21 23:14:34 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.544832838s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................................X.....X....X..X..........] duration: 28.724294958s FAIL (2025-07-21 23:14:10 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.724327282s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................................X.....X....X..X.........] duration: 17.533265788s FAIL (2025-07-21 23:12:58 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 17.533289433s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X.....X....X..X........] duration: 12.156174044s FAIL (2025-07-21 23:12:28 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.156216298s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......................................X.....X....X..X.......] duration: 23.055166359s FAIL (2025-07-21 23:12:10 UTC) operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 23.05518793s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)