Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 427.424834ms FAIL (2025-08-08 08:06:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 427.454171ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..................X.................................X.......] duration: 33.759003ms target: https://us1.storj.io/login FAIL (2025-08-08 08:06:48 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 33.789651ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 190.724219ms FAIL (2025-08-08 08:06:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 190.769025ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...................X.................................X......] duration: 29.57214ms target: https://us1.storj.io/login FAIL (2025-08-08 08:06:08 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.593353ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 421.048365ms FAIL (2025-08-08 08:05:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 421.079602ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [....................X.................................X.....] duration: 30.887192ms target: https://us1.storj.io/login FAIL (2025-08-08 08:05:40 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.921522ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.................................X....] duration: 28.081855ms target: https://us1.storj.io/login FAIL (2025-08-08 08:05:09 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.104719ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 188.96908ms FAIL (2025-08-08 08:04:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 189.000721ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [......................X.................................X...] duration: 27.614826ms target: https://us1.storj.io/login FAIL (2025-08-08 08:04:37 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 27.659459ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 731.866801ms FAIL (2025-08-08 08:04:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 731.899077ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.......................X.................................X..] duration: 31.654471ms target: https://us1.storj.io/login FAIL (2025-08-08 08:03:58 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.678859ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 188.06755ms FAIL (2025-08-08 08:03:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 188.101215ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 451.421ms FAIL (2025-08-08 08:03:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 451.45686ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 455.86213ms FAIL (2025-08-08 08:03:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 455.909204ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [........................X.................................X.] duration: 30.978614ms target: https://us1.storj.io/login FAIL (2025-08-08 08:03:01 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.998944ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 187.226617ms FAIL (2025-08-08 08:02:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 187.274992ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 510.497225ms FAIL (2025-08-08 08:02:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 510.528565ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 206.349682ms FAIL (2025-08-08 08:02:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 206.387406ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.................................X] duration: 8.335078ms target: https://us1.storj.io/login FAIL (2025-08-08 08:01:52 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 8.364409ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 393.01145ms FAIL (2025-08-08 08:01:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 393.038154ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 348.221569ms FAIL (2025-08-08 08:01:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 348.257937ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 408.782279ms FAIL (2025-08-08 08:00:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 408.812314ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 28.629771ms target: https://us1.storj.io/login FAIL (2025-08-08 08:00:54 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.704029ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.021559352s FAIL (2025-08-08 08:00:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 1.021617346s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 194.794865ms FAIL (2025-08-08 08:00:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 194.898828ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 34.477313ms target: https://us1.storj.io/login FAIL (2025-08-08 07:59:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 34.498814ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 478.63327ms FAIL (2025-08-08 07:59:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 478.660023ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 359.207747ms FAIL (2025-08-08 07:59:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 359.229797ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 27.064908ms target: https://us1.storj.io/login FAIL (2025-08-08 07:59:21 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 27.087143ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 171.149535ms FAIL (2025-08-08 07:58:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 171.223358ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 454.162455ms FAIL (2025-08-08 07:58:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 454.207622ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 28.80672ms target: https://us1.storj.io/login FAIL (2025-08-08 07:58:11 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.830025ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 171.818733ms FAIL (2025-08-08 07:57:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 171.848593ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 405.193622ms FAIL (2025-08-08 07:57:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 405.219928ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 530.185252ms FAIL (2025-08-08 07:57:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 530.208761ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 28.969721ms target: https://us1.storj.io/login FAIL (2025-08-08 07:57:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.005288ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 444.629191ms FAIL (2025-08-08 07:57:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 444.656542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 28.055362ms target: https://us1.storj.io/login FAIL (2025-08-08 07:56:40 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.078803ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 364.988385ms FAIL (2025-08-08 07:56:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 365.034011ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 198.365639ms FAIL (2025-08-08 07:56:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 198.386524ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 29.767161ms target: https://us1.storj.io/login FAIL (2025-08-08 07:56:07 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.845004ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 166.532946ms FAIL (2025-08-08 07:55:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 166.557008ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 472.20312ms FAIL (2025-08-08 07:55:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 472.311097ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 37.043269ms target: https://us1.storj.io/login FAIL (2025-08-08 07:55:32 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 37.068261ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 162.186657ms FAIL (2025-08-08 07:55:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 162.226254ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 409.493584ms FAIL (2025-08-08 07:55:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 409.517859ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 687.589079ms FAIL (2025-08-08 07:55:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 687.626027ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 179.673246ms FAIL (2025-08-08 07:55:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 179.7022ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 573.538119ms FAIL (2025-08-08 07:54:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 573.581493ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 30.878361ms target: https://us1.storj.io/login FAIL (2025-08-08 07:54:26 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.899359ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)