Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 191.751556ms FAIL (2025-08-08 07:54:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 191.770845ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 384.675987ms FAIL (2025-08-08 07:53:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 384.702588ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 192.436896ms FAIL (2025-08-08 07:53:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 192.463153ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 29.93263ms target: https://us1.storj.io/login FAIL (2025-08-08 07:53:38 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.033064ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 196.239178ms FAIL (2025-08-08 07:53:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 196.266845ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 373.138533ms FAIL (2025-08-08 07:53:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 373.167288ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 31.247448ms target: https://us1.storj.io/login FAIL (2025-08-08 07:52:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.275873ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 187.715778ms FAIL (2025-08-08 07:52:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 187.741877ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 206.202117ms FAIL (2025-08-08 07:52:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 206.233039ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 420.040153ms FAIL (2025-08-08 07:52:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 420.092397ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 185.113842ms FAIL (2025-08-08 07:51:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 185.142878ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 29.323853ms target: https://us1.storj.io/login FAIL (2025-08-08 07:51:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.35062ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 258.025473ms FAIL (2025-08-08 07:50:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 258.051312ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 375.641219ms FAIL (2025-08-08 07:50:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 375.668749ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 199.851073ms FAIL (2025-08-08 07:50:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 199.873768ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 721.993717ms FAIL (2025-08-08 07:50:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 722.021403ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 33.501772ms target: https://us1.storj.io/login FAIL (2025-08-08 07:50:21 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 33.539652ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 448.162934ms FAIL (2025-08-08 07:49:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 448.192381ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 30.667011ms target: https://us1.storj.io/login FAIL (2025-08-08 07:49:41 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.69484ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 438.722535ms FAIL (2025-08-08 07:49:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 438.749582ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 170.585517ms FAIL (2025-08-08 07:49:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 170.613647ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 7.17095812s target: https://us1.storj.io/login FAIL (2025-08-08 07:48:53 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 7.170981004s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 427.570437ms FAIL (2025-08-08 07:48:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 427.600676ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 446.515858ms FAIL (2025-08-08 07:48:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 446.546535ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 181.405297ms FAIL (2025-08-08 07:48:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 181.432102ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 34.778943ms target: https://us1.storj.io/login FAIL (2025-08-08 07:47:52 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 34.799428ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 195.987484ms FAIL (2025-08-08 07:47:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 196.015924ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 451.505828ms FAIL (2025-08-08 07:47:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 451.537155ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 176.114116ms FAIL (2025-08-08 07:47:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 176.140941ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 29.226742ms target: https://us1.storj.io/login FAIL (2025-08-08 07:47:04 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.250773ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 411.819514ms FAIL (2025-08-08 07:46:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 411.848543ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 206.79274ms FAIL (2025-08-08 07:46:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 206.836184ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 35.618144ms target: https://us1.storj.io/login FAIL (2025-08-08 07:45:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 35.653541ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 566.765468ms FAIL (2025-08-08 07:45:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 566.83312ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 29.384084ms target: https://us1.storj.io/login FAIL (2025-08-08 07:44:59 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.412882ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 188.286627ms FAIL (2025-08-08 07:44:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 188.377516ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 417.827562ms FAIL (2025-08-08 07:44:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 417.8561ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 460.254339ms FAIL (2025-08-08 07:44:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 460.296948ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 30.767658ms target: https://us1.storj.io/login FAIL (2025-08-08 07:44:11 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.791931ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 31.532079ms target: https://us1.storj.io/login FAIL (2025-08-08 07:43:54 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.557473ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 376.070672ms FAIL (2025-08-08 07:43:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 376.158889ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 182.234248ms FAIL (2025-08-08 07:43:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 182.258525ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 31.012804ms target: https://us1.storj.io/login FAIL (2025-08-08 07:42:57 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.042608ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 391.612743ms FAIL (2025-08-08 07:42:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 391.639524ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 190.781531ms FAIL (2025-08-08 07:42:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 190.824272ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 29.336418ms target: https://us1.storj.io/login FAIL (2025-08-08 07:42:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.363622ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 605.046204ms FAIL (2025-08-08 07:41:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 605.072152ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 452.507208ms FAIL (2025-08-08 07:41:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 452.53183ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 175.339345ms FAIL (2025-08-08 07:41:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 175.365304ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 31.681635ms target: https://us1.storj.io/login FAIL (2025-08-08 07:41:11 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.748915ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)