Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
234.223945ms
FAIL (2025-08-07 14:07:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 234.258344ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
218.836483ms
FAIL (2025-08-07 14:07:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 218.88316ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
194.17305ms
FAIL (2025-08-07 14:06:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 194.210501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
285.829214ms
FAIL (2025-08-07 14:05:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 285.86142ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
895.089596ms
FAIL (2025-08-07 14:04:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 895.12741ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
279.309628ms
FAIL (2025-08-07 14:04:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 279.335649ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
200.582169ms
FAIL (2025-08-07 14:03:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 200.675588ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
237.647959ms
FAIL (2025-08-07 14:03:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 237.773415ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
235.687446ms
FAIL (2025-08-07 14:02:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 235.734066ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
200.599267ms
FAIL (2025-08-07 14:01:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 200.637193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
384.210451ms
FAIL (2025-08-07 14:01:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 384.232864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
220.181612ms
FAIL (2025-08-07 14:00:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 220.242582ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
383.600773ms
FAIL (2025-08-07 14:00:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.629262ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
212.260111ms
FAIL (2025-08-07 13:59:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.286168ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
379.658654ms
FAIL (2025-08-07 13:59:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 379.683488ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
245.272546ms
FAIL (2025-08-07 13:58:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 245.307943ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
317.112985ms
FAIL (2025-08-07 13:57:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 317.135525ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
204.852509ms
FAIL (2025-08-07 13:56:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 204.876416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
216.455559ms
FAIL (2025-08-07 13:56:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 216.480466ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
206.133655ms
FAIL (2025-08-07 13:55:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 206.159121ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
587.297935ms
FAIL (2025-08-07 13:54:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 587.325574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
230.009403ms
FAIL (2025-08-07 13:53:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 230.056601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
320.289051ms
FAIL (2025-08-07 13:52:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 320.311127ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
205.046654ms
FAIL (2025-08-07 13:51:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.068855ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
227.946277ms
FAIL (2025-08-07 13:51:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 227.998866ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
611.051758ms
FAIL (2025-08-07 13:51:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 611.077421ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
286.863694ms
FAIL (2025-08-07 13:50:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 286.89315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
588.207448ms
FAIL (2025-08-07 13:50:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 588.236803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
42.00495ms
FAIL (2025-08-07 13:50:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 59.881823788s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:25.366724579 (4h3m59.881827156s) [upload=4240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:25.549529391 (4h4m0.064631975s) [upload=4240]: Done uploading segments... Aug 7 13:43:25.549558208 (4h4m0.064660785s) [upload=4240]: Upload finished. err: <nil> Aug 7 13:43:47.794823126 (4h4m22.309925706s) [upload=4253]: Starting upload Aug 7 13:43:47.794911342 (4h4m22.31001392s) [upload=4253]: Done starting upload Aug 7 13:43:47.795079112 (4h4m22.31018169s) [upload=4253]: Uploading segments... Aug 7 13:43:47.795130317 (4h4m22.310232905s) [upload=4253]: Got next segment. Inline: true Aug 7 13:43:47.795151055 (4h4m22.310253642s) [upload=4253]: Waiting for error group managing segments... Aug 7 13:43:47.795225870 (4h4m22.310328446s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:43:47.795231830 (4h4m22.310334406s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:43:47.795235495 (4h4m22.310338072s) [upload=4253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:43:47.877178597 (4h4m22.392281178s) [upload=4253]: Done uploading segments... Aug 7 13:43:47.877195871 (4h4m22.39229845s) [upload=4253]: Upload finished. err: <nil> Aug 7 13:44:20.360980806 (4h4m54.876083383s) [upload=4261]: Starting upload Aug 7 13:44:20.361042910 (4h4m54.876145498s) [upload=4261]: Done starting upload Aug 7 13:44:20.361120318 (4h4m54.876222897s) [upload=4261]: Uploading segments... Aug 7 13:44:20.361179224 (4h4m54.876281798s) [upload=4261]: Got next segment. Inline: true Aug 7 13:44:20.361187032 (4h4m54.87628962s) [upload=4261]: Waiting for error group managing segments... Aug 7 13:44:20.361238693 (4h4m54.876341274s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:44:20.361243948 (4h4m54.876346534s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:44:20.361247606 (4h4m54.876350187s) [upload=4261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:44:20.640629325 (4h4m55.155731902s) [upload=4261]: Done uploading segments... Aug 7 13:44:20.640638438 (4h4m55.155741014s) [upload=4261]: Upload finished. err: <nil> Aug 7 13:45:05.742516555 (4h5m40.257619123s) [upload=4277]: Starting upload Aug 7 13:45:05.742584413 (4h5m40.257686992s) [upload=4277]: Done starting upload Aug 7 13:45:05.742662387 (4h5m40.257764955s) [upload=4277]: Uploading segments... Aug 7 13:45:05.742709463 (4h5m40.257812049s) [upload=4277]: Got next segment. Inline: true Aug 7 13:45:05.742716429 (4h5m40.257819013s) [upload=4277]: Waiting for error group managing segments... Aug 7 13:45:05.742856190 (4h5m40.257958755s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:05.742862173 (4h5m40.257964753s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:05.742866204 (4h5m40.257968785s) [upload=4277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:05.834184064 (4h5m40.349286641s) [upload=4277]: Done uploading segments... Aug 7 13:45:05.834203939 (4h5m40.349306515s) [upload=4277]: Upload finished. err: <nil> Aug 7 13:45:46.885620332 (4h6m21.400722903s) [upload=4287]: Starting upload Aug 7 13:45:46.885683797 (4h6m21.400786374s) [upload=4287]: Done starting upload Aug 7 13:45:46.885755665 (4h6m21.400858242s) [upload=4287]: Uploading segments... Aug 7 13:45:46.885820794 (4h6m21.400923379s) [upload=4287]: Got next segment. Inline: true Aug 7 13:45:46.885826557 (4h6m21.400929141s) [upload=4287]: Waiting for error group managing segments... Aug 7 13:45:46.885897836 (4h6m21.401000418s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:45:46.885903868 (4h6m21.401006452s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:45:46.885908315 (4h6m21.401010899s) [upload=4287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:45:47.096381807 (4h6m21.611484393s) [upload=4287]: Done uploading segments... Aug 7 13:45:47.096427589 (4h6m21.611530159s) [upload=4287]: Upload finished. err: <nil> Aug 7 13:46:46.497517585 (4h7m21.012620163s) [upload=4305]: Starting upload Aug 7 13:46:46.497582024 (4h7m21.012684623s) [upload=4305]: Done starting upload Aug 7 13:46:46.497662009 (4h7m21.012764586s) [upload=4305]: Uploading segments... Aug 7 13:46:46.497755785 (4h7m21.012858371s) [upload=4305]: Got next segment. Inline: true Aug 7 13:46:46.497763403 (4h7m21.01286598s) [upload=4305]: Waiting for error group managing segments... Aug 7 13:46:46.497833628 (4h7m21.012936205s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:46:46.497839890 (4h7m21.012942471s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:46:46.497843389 (4h7m21.012945967s) [upload=4305]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:46:46.592140106 (4h7m21.107242717s) [upload=4305]: Done uploading segments... Aug 7 13:46:46.592159595 (4h7m21.107262164s) [upload=4305]: Upload finished. err: <nil> Aug 7 13:47:17.747284054 (4h7m52.262386628s) [upload=4312]: Starting upload Aug 7 13:47:17.747335200 (4h7m52.262437835s) [upload=4312]: Done starting upload Aug 7 13:47:17.747414481 (4h7m52.262517048s) [upload=4312]: Uploading segments... Aug 7 13:47:17.747494112 (4h7m52.262596698s) [upload=4312]: Got next segment. Inline: true Aug 7 13:47:17.747501701 (4h7m52.262604284s) [upload=4312]: Waiting for error group managing segments... Aug 7 13:47:17.747559305 (4h7m52.262661872s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:17.747564711 (4h7m52.262667287s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:17.747568131 (4h7m52.262670697s) [upload=4312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:17.820403597 (4h7m52.335506168s) [upload=4312]: Done uploading segments... Aug 7 13:47:17.820424961 (4h7m52.335527533s) [upload=4312]: Upload finished. err: <nil> Aug 7 13:47:39.146675912 (4h8m13.66177848s) [upload=4320]: Starting upload Aug 7 13:47:39.146755074 (4h8m13.661857637s) [upload=4320]: Done starting upload Aug 7 13:47:39.146846999 (4h8m13.661949569s) [upload=4320]: Uploading segments... Aug 7 13:47:39.146883422 (4h8m13.661986008s) [upload=4320]: Got next segment. Inline: true Aug 7 13:47:39.146888277 (4h8m13.661990856s) [upload=4320]: Waiting for error group managing segments... Aug 7 13:47:39.146937764 (4h8m13.66204034s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:47:39.146942638 (4h8m13.662045214s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:47:39.146946243 (4h8m13.66204882s) [upload=4320]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:47:39.221474885 (4h8m13.73657747s) [upload=4320]: Done uploading segments... Aug 7 13:47:39.221494668 (4h8m13.736597254s) [upload=4320]: Upload finished. err: <nil> Aug 7 13:48:29.885038305 (4h9m4.400140881s) [upload=4330]: Starting upload Aug 7 13:48:29.885102474 (4h9m4.400205052s) [upload=4330]: Done starting upload Aug 7 13:48:29.885229748 (4h9m4.400332328s) [upload=4330]: Uploading segments... Aug 7 13:48:29.885301994 (4h9m4.400404581s) [upload=4330]: Got next segment. Inline: true Aug 7 13:48:29.885309625 (4h9m4.400412192s) [upload=4330]: Waiting for error group managing segments... Aug 7 13:48:29.885361859 (4h9m4.400464442s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:48:29.885368057 (4h9m4.400470634s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:29.885371748 (4h9m4.400474325s) [upload=4330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:48:29.953717833 (4h9m4.468820416s) [upload=4330]: Done uploading segments... Aug 7 13:48:29.953737036 (4h9m4.468839598s) [upload=4330]: Upload finished. err: <nil> Aug 7 13:49:40.264723635 (4h10m14.779826204s) [upload=4353]: Starting upload Aug 7 13:49:40.264772642 (4h10m14.779875218s) [upload=4353]: Done starting upload Aug 7 13:49:40.264849300 (4h10m14.779951876s) [upload=4353]: Uploading segments... Aug 7 13:49:40.264888364 (4h10m14.779990947s) [upload=4353]: Got next segment. Inline: true Aug 7 13:49:40.264893612 (4h10m14.779996193s) [upload=4353]: Waiting for error group managing segments... Aug 7 13:49:40.264934759 (4h10m14.780037337s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:49:40.264939076 (4h10m14.780041652s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:40.264942179 (4h10m14.780044758s) [upload=4353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:49:40.614328683 (4h10m15.129431249s) [upload=4353]: Done uploading segments... Aug 7 13:49:40.614346835 (4h10m15.129449402s) [upload=4353]: Upload finished. err: <nil> Aug 7 13:50:22.709423205 (4h10m57.224525771s) [upload=4364]: Starting upload Aug 7 13:50:22.709471509 (4h10m57.224574077s) [upload=4364]: Done starting upload Aug 7 13:50:22.709537763 (4h10m57.224640337s) [upload=4364]: Uploading segments... Aug 7 13:50:22.709583201 (4h10m57.224685787s) [upload=4364]: Got next segment. Inline: true Aug 7 13:50:22.709588756 (4h10m57.224691319s) [upload=4364]: Waiting for error group managing segments... Aug 7 13:50:22.709635263 (4h10m57.224737826s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 13:50:22.709639846 (4h10m57.224742424s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:22.709643210 (4h10m57.224745787s) [upload=4364]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 13:50:22.718359558 (4h10m57.233462141s) [upload=4364]: Done uploading segments... Aug 7 13:50:22.718385465 (4h10m57.233488038s) [upload=4364]: Upload finished. err: metaclient: Too Many Requests
Duration: 42.02728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
460.896325ms
FAIL (2025-08-07 13:49:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 460.922059ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
540.748593ms
FAIL (2025-08-07 13:48:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 540.776382ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
636.316073ms
FAIL (2025-08-07 13:48:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 636.384484ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
683.785516ms
FAIL (2025-08-07 13:47:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 683.816142ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.869419145s
FAIL (2025-08-07 13:47:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 1.869445882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
482.039849ms
FAIL (2025-08-07 13:46:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 482.068496ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
550.583595ms
FAIL (2025-08-07 13:46:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 550.618604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
856.820604ms
FAIL (2025-08-07 13:45:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 856.845737ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.12459163s
FAIL (2025-08-07 13:44:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 1.124619631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
454.198324ms
FAIL (2025-08-07 13:43:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 454.228539ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
727.370156ms
FAIL (2025-08-07 13:42:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 727.401752ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
445.982968ms
FAIL (2025-08-07 13:42:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 446.217436ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
449.44188ms
FAIL (2025-08-07 13:41:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 449.474666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
616.097117ms
FAIL (2025-08-07 13:40:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 616.126176ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
520.963823ms
FAIL (2025-08-07 13:39:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 520.987231ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
583.561284ms
FAIL (2025-08-07 13:38:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 583.58935ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
495.908334ms
FAIL (2025-08-07 13:37:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 495.936518ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
542.641413ms
FAIL (2025-08-07 13:36:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 542.683835ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
548.202366ms
FAIL (2025-08-07 13:35:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 548.226848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
502.015012ms
FAIL (2025-08-07 13:35:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 502.044555ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
480.045421ms
FAIL (2025-08-07 13:34:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
load=3646]: Done uploading segments...
Aug 7 13:08:42.014057871 (3h29m16.529160455s) [upload=3646]: Upload finished. err: <nil>
Aug 7 13:09:45.907888588 (3h30m20.422991166s) [upload=3662]: Starting upload
Aug 7 13:09:45.907975519 (3h30m20.423078085s) [upload=3662]: Done starting upload
Aug 7 13:09:45.908116977 (3h30m20.423219544s) [upload=3662]: Uploading segments...
Aug 7 13:09:45.908368369 (3h30m20.423470953s) [upload=3662]: Got next segment. Inline: false
Aug 7 13:09:45.908445828 (3h30m20.423548419s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 13:09:45.908453988 (3h30m20.423556575s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 13:09:46.069482153 (3h30m20.584584729s) [seg_pos={0 0}, upload=3662]: Begin upload segment...
Aug 7 13:09:46.069531131 (3h30m20.584633708s) [seg_pos={0 0}, upload=3662]: Done begin upload segment.
Aug 7 13:09:46.069555026 (3h30m20.584657605s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069574610 (3h30m20.584677188s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.069974479 (3h30m20.585077055s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070099067 (3h30m20.585201649s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070287162 (3h30m20.58538974s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070475982 (3h30m20.585578561s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070608672 (3h30m20.585711238s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070878440 (3h30m20.585981021s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.070902066 (3h30m20.586004643s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071210245 (3h30m20.586312824s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071342142 (3h30m20.586444723s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071551645 (3h30m20.586654224s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071830848 (3h30m20.586933427s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.071972989 (3h30m20.587075565s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072226518 (3h30m20.587329097s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072283311 (3h30m20.587385896s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072556298 (3h30m20.58765888s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.072580568 (3h30m20.587683146s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Uploading piece...
Aug 7 13:09:46.154462661 (3h30m20.669565251s) [upload=3662]: Next returned nil segment
Aug 7 13:09:46.154492526 (3h30m20.669595108s) [upload=3662]: Waiting for error group managing segments...
Aug 7 13:09:46.170141964 (3h30m20.685244532s) [noise=true , address=45.91.116.7:4013 , piece_id=2I2K2PIMMU65F5ZVQFZBADPTADY6DJGFFXR5YNSTMYMG5JMEXWDQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.173526739 (3h30m20.688629315s) [noise=true , address=104.36.82.59:4331 , piece_id=DUZSKUEB7SAIKZUWTFWFACIDSPFRHJFDI3WLW55HJ5VDCCDNYWRQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.174559479 (3h30m20.689662044s) [noise=true , address=45.91.116.9:4294 , piece_id=BBO7PVLSX7OETNVSMFWVU2IZDOTYVU6HXVQGP6BBKHC24ZE7CFZA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179606736 (3h30m20.694709324s) [noise=true , address=104.36.82.37:4679 , piece_id=UAYRNJK5TXDZ32GBEUHG6OX6ROWBFNVO2FM34UP5UV5GW6TOSNIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.179837647 (3h30m20.694940214s) [noise=true , address=104.36.82.44:4900 , piece_id=LYOFPBSZ7F3JZEVX2B5ZP5VSMXDFTXBETHHMBJJKMNZF7JKR3HIA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180275307 (3h30m20.695377877s) [noise=true , address=104.36.82.62:4423 , piece_id=J3N54S5FXK3V5IHHYWXTHDC35LUOXKS326GFYKXNWZ5RCDJRWDKA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.180530203 (3h30m20.695632785s) [noise=true , address=104.36.82.56:4252 , piece_id=5HA2E67GA2NOH7BR352TQ55UYBJKHKNANX7FSU3W2U3Z5QE67IIQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.183526937 (3h30m20.698629507s) [noise=true , address=104.36.82.46:4493 , piece_id=SDYW7C4PEXDR2IQAD27PF5ST3KVC3PB52MCFYOAQCITWPSQPTFRA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.185857435 (3h30m20.700959998s) [noise=true , address=104.36.82.52:4113 , piece_id=U2OEK6CKASWECJELE3OIFU6YFZURTFLDOEHFN4S3N7P7CYKHZ52A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.186311191 (3h30m20.701413771s) [noise=true , address=104.36.82.61:4402 , piece_id=VLI2YWTPJJXIYRHJEZEY6OA662OP2YVKXEH7LWG66UKJLDCAVMFQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.192811522 (3h30m20.707914091s) [noise=true , address=104.36.82.16:4304 , piece_id=CDANDMRHU4FOBVCDI6XL3FSIGJIAQI6B52X4D5A6ATATYYWUJMNQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.196064978 (3h30m20.711167547s) [noise=true , address=104.36.82.55:4196 , piece_id=HZLS2QEAPGSLP3WABJ6U4M2IGNPG346HKNOMTRGEAQD2FVLHN7KA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199127531 (3h30m20.714230101s) [noise=true , address=104.36.82.5:4843 , piece_id=YXDR7C3QOE2RQDMY4ZF4ZNZJGU27OYY3CTV3LO7US5Y4K6YWVLZQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199146222 (3h30m20.714248796s) [noise=true , address=104.36.82.23:4466 , piece_id=F7NDFOX6YIQK6WGDJAUMXQBKIAVWTEQZFHCKQGOXRFLBB2QU4LTA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: <nil>
Aug 7 13:09:46.199161204 (3h30m20.71426377s) [seg_pos={0 0}, upload=3662]: Segment reached optimal threshold of 14 pieces.
Aug 7 13:09:46.199312816 (3h30m20.714415384s) [noise=true , address=104.36.82.14:4242 , piece_id=TNPKZIDYP3RUO75CF5JUVXHQCD3ULKX7OPNUFU4EUFDMANJFDO5A, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199325722 (3h30m20.714428299s) [noise=true , address=104.36.82.54:4182 , piece_id=BGB6GG7FB2DIXBLIAU5SIPU6Y52SLZHRJUHUSGKCWSO65EN3YOOA, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HbkH31sfDUnZLXAbmzQphcFYmzB8MQo98Q6Ufbo59et42zxMy): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199397268 (3h30m20.714499836s) [noise=true , address=104.36.82.13:4190 , piece_id=SRSDUQ77EUJGZNKMFJYNS7U43G6FWPBVPW35UYC65KLOJJ6VXS6Q, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eNJzs5Dc7Nv7imoQXZDp2mEVWjD8o4viGVkFvuAeZ1arynxu4): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199437081 (3h30m20.714539658s) [noise=true , address=104.36.82.47:4540 , piece_id=V6T2IGEEQYQM5CEZF3VV6PFODUC2OESNXDKTILZ54OAGHGHDANCQ, seg_pos={0 0}, upload=3662]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF
Aug 7 13:09:46.199478771 (3h30m20.714581353s) [seg_pos={0 0}, upload=3662]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 13:09:46.199584458 (3h30m20.714687043s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 13:09:46.199590791 (3h30m20.714693377s) [upload=3662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 13:09:46.571590605 (3h30m21.086693186s) [upload=3662]: Done uploading segments...
Aug 7 13:09:46.571612434 (3h30m21.086714996s) [upload=3662]: Upload finished. err: <nil>
Duration: 480.071575ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|