Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
42.242802ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:25:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 42.272645ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
36.434111ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:24:48 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 36.655512ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
41.668933ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:24:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 41.704385ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
33.667453ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:23:06 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.692652ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
28.209524ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:22:24 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 28.226525ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
35.706557ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:21:26 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 35.725846ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [X.....................................X.....................] duration:
33.110962ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:20:27 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.138849ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................................X....................] duration:
44.173789ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:19:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 44.197256ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration:
59.229587ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:18:41 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 59.270736ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration:
30.120354ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:17:57 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.145465ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration:
31.930265ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:16:46 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.024307ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration:
40.099507ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:15:42 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 40.132713ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration:
32.269038ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:14:57 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.307819ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration:
32.100632ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:14:02 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 32.140837ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [........X.....................................X.............] duration:
30.234187ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:13:38 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.25763ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.........X.....................................X............] duration:
29.453208ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:12:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 29.471077ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..........X.....................................X...........] duration:
34.928853ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:12:31 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 34.952988ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...........X.....................................X..........] duration:
35.915983ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:11:36 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 35.93839ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [............X.....................................X.........] duration:
27.602372ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:10:21 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 27.623992ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.............X.....................................X........] duration:
33.385725ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:09:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.416918ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..............X.....................................X.......] duration:
58.117316ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:08:31 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 58.156963ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...............X.....................................X......] duration:
37.788671ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:07:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 37.812991ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [................X.....................................X.....] duration:
30.749637ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:06:48 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.783089ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.................X.....................................X....] duration:
35.609299ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:06:09 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 35.646182ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
195.321878ms
FAIL (2025-08-08 02:05:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 195.375268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..................X.....................................X...] duration:
31.478306ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:05:19 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 31.501528ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
216.796213ms
FAIL (2025-08-08 02:05:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 216.846619ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...................X.....................................X..] duration:
33.762198ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:04:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 33.78648ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
399.771139ms
FAIL (2025-08-08 02:04:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 399.810177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [....................X.....................................X.] duration:
36.639904ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:04:13 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 36.652302ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
329.381872ms
FAIL (2025-08-08 02:04:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 329.410509ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.....................................X] duration:
8.042238ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:03:45 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 8.073847ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
201.658479ms
FAIL (2025-08-08 02:03:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 201.690119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
34.778859ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:03:08 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 34.804907ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
205.146553ms
FAIL (2025-08-08 02:02:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.193882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
334.200842ms
FAIL (2025-08-08 02:02:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 334.238139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
31.849695ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:01:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 31.885822ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
27.996275ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:01:32 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 28.024643ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
213.433664ms
FAIL (2025-08-08 02:01:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 213.459394ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
28.992821ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:00:58 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 29.019378ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
87.869971ms target:
https://us1.storj.io/login
FAIL (2025-08-08 02:00:40 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 87.892021ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
187.867853ms
FAIL (2025-08-08 02:00:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.966575ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
38.594012ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:59:52 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 38.634369ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
187.958615ms
FAIL (2025-08-08 01:59:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.98672ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
31.37105ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:58:57 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 31.401847ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
201.735424ms
FAIL (2025-08-08 01:58:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 201.769425ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
184.10269ms
FAIL (2025-08-08 01:58:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.14113ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
30.000361ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:57:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 30.020057ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
319.132013ms
FAIL (2025-08-08 01:57:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== ... Aug 8 01:13:32.016665378 (15h34m6.531767945s) [upload=16034]: Upload finished. err: <nil> Aug 8 01:13:56.018236159 (15h34m30.533338752s) [upload=16043]: Starting upload Aug 8 01:13:56.018304851 (15h34m30.533407433s) [upload=16043]: Done starting upload Aug 8 01:13:56.018361532 (15h34m30.533464101s) [upload=16043]: Uploading segments... Aug 8 01:13:56.018437882 (15h34m30.533540462s) [upload=16043]: Got next segment. Inline: true Aug 8 01:13:56.018444381 (15h34m30.533546959s) [upload=16043]: Waiting for error group managing segments... Aug 8 01:13:56.018490460 (15h34m30.533593037s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:13:56.018495080 (15h34m30.533597657s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:13:56.018498109 (15h34m30.533600699s) [upload=16043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:13:56.098636745 (15h34m30.613739343s) [upload=16043]: Done uploading segments... Aug 8 01:13:56.098655758 (15h34m30.613758326s) [upload=16043]: Upload finished. err: <nil> Aug 8 01:14:24.615408874 (15h34m59.130511451s) [upload=16054]: Starting upload Aug 8 01:14:24.615460932 (15h34m59.130563508s) [upload=16054]: Done starting upload Aug 8 01:14:24.615534424 (15h34m59.130637001s) [upload=16054]: Uploading segments... Aug 8 01:14:24.615583186 (15h34m59.130685777s) [upload=16054]: Got next segment. Inline: true Aug 8 01:14:24.615589195 (15h34m59.130691772s) [upload=16054]: Waiting for error group managing segments... Aug 8 01:14:24.615647516 (15h34m59.130750093s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:14:24.615653960 (15h34m59.130756539s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:14:24.615658359 (15h34m59.130760936s) [upload=16054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:14:24.702851246 (15h34m59.217953823s) [upload=16054]: Done uploading segments... Aug 8 01:14:24.702888715 (15h34m59.217991291s) [upload=16054]: Upload finished. err: <nil> Aug 8 01:15:38.321095418 (15h36m12.836198004s) [upload=16073]: Starting upload Aug 8 01:15:38.321153735 (15h36m12.836256311s) [upload=16073]: Done starting upload Aug 8 01:15:38.321212948 (15h36m12.836315513s) [upload=16073]: Uploading segments... Aug 8 01:15:38.321249839 (15h36m12.836352422s) [upload=16073]: Got next segment. Inline: true Aug 8 01:15:38.321254424 (15h36m12.83635699s) [upload=16073]: Waiting for error group managing segments... Aug 8 01:15:38.321295982 (15h36m12.836398559s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:15:38.321300893 (15h36m12.83640346s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:15:38.321304075 (15h36m12.836406642s) [upload=16073]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:15:38.390829923 (15h36m12.905932488s) [upload=16073]: Done uploading segments... Aug 8 01:15:38.390848766 (15h36m12.905951332s) [upload=16073]: Upload finished. err: <nil> Aug 8 01:16:51.390944653 (15h37m25.906047236s) [upload=16096]: Starting upload Aug 8 01:16:51.391011766 (15h37m25.906114353s) [upload=16096]: Done starting upload Aug 8 01:16:51.391145544 (15h37m25.906248108s) [upload=16096]: Uploading segments... Aug 8 01:16:51.391197811 (15h37m25.906300394s) [upload=16096]: Got next segment. Inline: true Aug 8 01:16:51.391204050 (15h37m25.906306642s) [upload=16096]: Waiting for error group managing segments... Aug 8 01:16:51.391256651 (15h37m25.906359231s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:16:51.391261684 (15h37m25.906364267s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:16:51.391264863 (15h37m25.906367444s) [upload=16096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:16:51.472233995 (15h37m25.987336571s) [upload=16096]: Done uploading segments... Aug 8 01:16:51.472252641 (15h37m25.987355216s) [upload=16096]: Upload finished. err: <nil> Aug 8 01:18:05.014247695 (15h38m39.529350263s) [upload=16114]: Starting upload Aug 8 01:18:05.014303740 (15h38m39.529406315s) [upload=16114]: Done starting upload Aug 8 01:18:05.014370865 (15h38m39.529473438s) [upload=16114]: Uploading segments... Aug 8 01:18:05.014467752 (15h38m39.529570337s) [upload=16114]: Got next segment. Inline: true Aug 8 01:18:05.014476834 (15h38m39.529579424s) [upload=16114]: Waiting for error group managing segments... Aug 8 01:18:05.014552206 (15h38m39.529654786s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:05.014575699 (15h38m39.529678284s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:05.014580851 (15h38m39.529683429s) [upload=16114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:05.173375558 (15h38m39.688478134s) [upload=16114]: Done uploading segments... Aug 8 01:18:05.173392883 (15h38m39.68849546s) [upload=16114]: Upload finished. err: <nil> Aug 8 01:18:52.130649287 (15h39m26.645751864s) [upload=16126]: Starting upload Aug 8 01:18:52.130725876 (15h39m26.645828445s) [upload=16126]: Done starting upload Aug 8 01:18:52.130789702 (15h39m26.645892273s) [upload=16126]: Uploading segments... Aug 8 01:18:52.130844581 (15h39m26.645947167s) [upload=16126]: Got next segment. Inline: true Aug 8 01:18:52.130851731 (15h39m26.645954312s) [upload=16126]: Waiting for error group managing segments... Aug 8 01:18:52.130904584 (15h39m26.64600716s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:18:52.130909120 (15h39m26.646011698s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:18:52.130912741 (15h39m26.646015319s) [upload=16126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:18:52.217898747 (15h39m26.733001324s) [upload=16126]: Done uploading segments... Aug 8 01:18:52.217935549 (15h39m26.733038116s) [upload=16126]: Upload finished. err: <nil> Aug 8 01:19:55.517120496 (15h40m30.032223072s) [upload=16145]: Starting upload Aug 8 01:19:55.517180374 (15h40m30.032282951s) [upload=16145]: Done starting upload Aug 8 01:19:55.517245083 (15h40m30.03234765s) [upload=16145]: Uploading segments... Aug 8 01:19:55.517315966 (15h40m30.032418533s) [upload=16145]: Got next segment. Inline: true Aug 8 01:19:55.517325222 (15h40m30.032427789s) [upload=16145]: Waiting for error group managing segments... Aug 8 01:19:55.517381429 (15h40m30.032484008s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:19:55.517386048 (15h40m30.032488627s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:19:55.517389320 (15h40m30.032491899s) [upload=16145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:19:55.743600413 (15h40m30.258702989s) [upload=16145]: Done uploading segments... Aug 8 01:19:55.743616927 (15h40m30.258719502s) [upload=16145]: Upload finished. err: <nil> Aug 8 01:20:29.257594160 (15h41m3.772696735s) [upload=16155]: Starting upload Aug 8 01:20:29.257669520 (15h41m3.772772097s) [upload=16155]: Done starting upload Aug 8 01:20:29.257763018 (15h41m3.772865587s) [upload=16155]: Uploading segments... Aug 8 01:20:29.257821897 (15h41m3.772924477s) [upload=16155]: Got next segment. Inline: true Aug 8 01:20:29.257826572 (15h41m3.772929149s) [upload=16155]: Waiting for error group managing segments... Aug 8 01:20:29.257891306 (15h41m3.772993878s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:20:29.257896584 (15h41m3.77299916s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:20:29.257900084 (15h41m3.773002662s) [upload=16155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:20:29.324124067 (15h41m3.839226651s) [upload=16155]: Done uploading segments... Aug 8 01:20:29.324146082 (15h41m3.83924866s) [upload=16155]: Upload finished. err: <nil> Aug 8 01:21:06.298907732 (15h41m40.814010326s) [upload=16166]: Starting upload Aug 8 01:21:06.298993044 (15h41m40.814095611s) [upload=16166]: Done starting upload Aug 8 01:21:06.299105277 (15h41m40.814207854s) [upload=16166]: Uploading segments... Aug 8 01:21:06.299160453 (15h41m40.814263038s) [upload=16166]: Got next segment. Inline: true Aug 8 01:21:06.299167359 (15h41m40.814269942s) [upload=16166]: Waiting for error group managing segments... Aug 8 01:21:06.299225227 (15h41m40.81432781s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:21:06.299231100 (15h41m40.814333685s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:21:06.299234372 (15h41m40.814336952s) [upload=16166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:21:06.367725210 (15h41m40.882827793s) [upload=16166]: Done uploading segments... Aug 8 01:21:06.367746234 (15h41m40.882848808s) [upload=16166]: Upload finished. err: <nil> Aug 8 01:22:05.005652421 (15h42m39.520754988s) [upload=16184]: Starting upload Aug 8 01:22:05.005701629 (15h42m39.520804207s) [upload=16184]: Done starting upload Aug 8 01:22:05.005780317 (15h42m39.520882894s) [upload=16184]: Uploading segments... Aug 8 01:22:05.005831789 (15h42m39.520934371s) [upload=16184]: Got next segment. Inline: true Aug 8 01:22:05.005837134 (15h42m39.520939711s) [upload=16184]: Waiting for error group managing segments... Aug 8 01:22:05.005889408 (15h42m39.520991984s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:22:05.005893853 (15h42m39.520996429s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:22:05.005897232 (15h42m39.52099981s) [upload=16184]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:22:05.013405083 (15h42m39.528507659s) [upload=16184]: Done uploading segments... Aug 8 01:22:05.013421146 (15h42m39.528523713s) [upload=16184]: Upload finished. err: metaclient: Too Many Requests
Duration: 319.163092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
35.292725ms target:
https://us1.storj.io/login
FAIL (2025-08-08 01:56:56 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 35.315153ms
core
satellite
us1
|