Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 202.627258ms FAIL (2025-08-08 09:58:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 202.662905ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 408.546957ms FAIL (2025-08-08 09:58:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 408.577605ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 198.986229ms FAIL (2025-08-08 09:57:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 199.017464ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 598.072837ms FAIL (2025-08-08 09:57:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 598.105008ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 298.341757ms FAIL (2025-08-08 09:57:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 298.369949ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 214.141343ms FAIL (2025-08-08 09:56:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 214.16936ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 180.831497ms FAIL (2025-08-08 09:56:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 180.859854ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 490.382386ms FAIL (2025-08-08 09:56:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 490.413059ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 238.915605ms FAIL (2025-08-08 09:56:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 238.942686ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 475.181817ms FAIL (2025-08-08 09:55:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 475.209114ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 194.545954ms FAIL (2025-08-08 09:54:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 194.572108ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 382.713085ms FAIL (2025-08-08 09:54:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 382.742472ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 188.120036ms FAIL (2025-08-08 09:54:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 188.202953ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 399.300264ms FAIL (2025-08-08 09:54:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 399.327417ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 191.673653ms FAIL (2025-08-08 09:54:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 191.703912ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 215.587285ms FAIL (2025-08-08 09:53:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 215.613934ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 551.298236ms FAIL (2025-08-08 09:53:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 551.331831ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 193.511562ms FAIL (2025-08-08 09:53:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 193.536609ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 490.337629ms FAIL (2025-08-08 09:52:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 490.3642ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 223.227525ms FAIL (2025-08-08 09:52:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 223.251178ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 422.407839ms FAIL (2025-08-08 09:51:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 422.432138ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 218.299752ms FAIL (2025-08-08 09:51:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 218.323458ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.103650007s FAIL (2025-08-08 09:51:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 1.103714257s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 590.809904ms FAIL (2025-08-08 09:50:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 590.976607ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 186.172565ms FAIL (2025-08-08 09:50:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 186.198814ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 412.589617ms FAIL (2025-08-08 09:50:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 412.628271ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 191.83254ms FAIL (2025-08-08 09:49:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 191.860834ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 548.813255ms FAIL (2025-08-08 09:49:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 548.90626ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 398.75193ms FAIL (2025-08-08 09:49:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 398.78355ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 176.560323ms FAIL (2025-08-08 09:48:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 176.587561ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 410.17816ms FAIL (2025-08-08 09:47:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 410.210981ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 202.40927ms FAIL (2025-08-08 09:47:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 202.431811ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 442.33961ms FAIL (2025-08-08 09:46:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 442.389503ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 572.960729ms FAIL (2025-08-08 09:46:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 572.990142ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 948.353671ms FAIL (2025-08-08 09:46:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 948.380248ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 39.399023ms FAIL (2025-08-08 09:45:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 39.422551ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 234.241509ms FAIL (2025-08-08 09:45:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 234.274025ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 188.142821ms FAIL (2025-08-08 09:44:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 188.184118ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 419.692143ms FAIL (2025-08-08 09:44:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 419.738933ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 205.180642ms FAIL (2025-08-08 09:42:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 205.208246ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 190.169066ms FAIL (2025-08-08 09:42:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 190.221839ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 209.276091ms FAIL (2025-08-08 09:41:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 209.305562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 197.817867ms FAIL (2025-08-08 09:40:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 197.936652ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 184.297315ms FAIL (2025-08-08 09:39:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 184.325634ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 213.062381ms FAIL (2025-08-08 09:39:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 213.087454ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 210.462742ms FAIL (2025-08-08 09:38:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 210.750398ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 191.424686ms FAIL (2025-08-08 09:38:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 191.453687ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 197.501436ms FAIL (2025-08-08 09:36:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 197.527423ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 414.215298ms FAIL (2025-08-08 09:35:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 414.241222ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 223.170731ms FAIL (2025-08-08 09:35:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 223.335694ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)