Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
183.006417ms
FAIL (2025-08-08 01:56:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.031178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
32.5486ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:56:04 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.586684ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
28.94856ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:55:31 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 28.975122ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
303.165456ms
FAIL (2025-08-08 01:55:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 303.193848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
28.553904ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:54:19 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 28.583183ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
190.404873ms
FAIL (2025-08-08 01:54:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 190.447451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
573.516141ms
FAIL (2025-08-08 01:53:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 573.540779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
38.738638ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:53:11 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 38.77631ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
408.473644ms
FAIL (2025-08-08 01:52:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 408.500831ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
28.412658ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:52:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 28.434778ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
347.583826ms
FAIL (2025-08-08 01:52:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 347.607981ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
214.38098ms
FAIL (2025-08-08 01:52:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 214.405767ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
29.32894ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:51:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 29.352818ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
185.06674ms
FAIL (2025-08-08 01:51:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 185.109869ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
32.220228ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:51:35 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.24809ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
216.147502ms
FAIL (2025-08-08 01:51:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 216.184646ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
32.3894ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:50:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.414253ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
178.960033ms
FAIL (2025-08-08 01:50:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.997917ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
30.997185ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:49:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 31.019662ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
202.37881ms
FAIL (2025-08-08 01:49:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 202.405063ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
29.437783ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:48:48 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 29.477079ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
30.014361ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:48:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.06726ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
246.454941ms
FAIL (2025-08-08 01:48:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 246.479086ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
33.900696ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:47:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.925028ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
32.630381ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:47:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.671067ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
215.881496ms
FAIL (2025-08-08 01:47:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.90394ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
207.620429ms
FAIL (2025-08-08 01:46:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.647285ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
30.976188ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:46:18 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.998419ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
514.792087ms
FAIL (2025-08-08 01:45:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 514.820394ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
32.376889ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:45:13 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.421794ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
27.893421ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:44:57 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 27.914628ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
28.009231ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:44:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 28.048278ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
217.928318ms
FAIL (2025-08-08 01:44:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 217.978541ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
264.754857ms
FAIL (2025-08-08 01:43:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 264.798104ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
30.847447ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:43:09 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.875119ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
225.000745ms
FAIL (2025-08-08 01:43:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 225.029392ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
238.357922ms
FAIL (2025-08-08 01:42:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 238.395062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
32.73752ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:42:14 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.78421ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
247.645405ms
FAIL (2025-08-08 01:41:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 247.675139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
382.331541ms
FAIL (2025-08-08 01:41:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 382.370918ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
34.945885ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:41:12 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 34.970608ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.099038979s
FAIL (2025-08-08 01:40:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.099068311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
29.657908ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:40:39 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 29.694466ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
263.151242ms
FAIL (2025-08-08 01:40:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 263.179324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
28.976145ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:40:08 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 29.001743ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
290.074383ms
FAIL (2025-08-08 01:39:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 290.110745ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
33.199757ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:39:00 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.230028ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
221.597802ms
FAIL (2025-08-08 01:38:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 221.629151ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
33.394515ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:38:11 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.420384ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
190.323778ms
FAIL (2025-08-08 01:38:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 190.348361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|