Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
252.037829ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:27:20 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 252.069229ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
249.775133ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:27:02 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.803154ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
750.07032ms
FAIL (2025-07-18 11:26:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 750.102008ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
252.119115ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:26:20 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 252.142741ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
647.357171ms
FAIL (2025-07-18 11:25:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 647.557135ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
254.167254ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:25:11 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 254.187556ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
411.603746ms
FAIL (2025-07-18 11:24:53 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 411.65653ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
252.641557ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:24:34 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 252.666347ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
255.959181ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:24:14 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 255.983967ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
461.684401ms
FAIL (2025-07-18 11:23:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 461.713248ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
248.012978ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:23:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 248.036835ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
518.486312ms
FAIL (2025-07-18 11:22:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 518.517581ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
262.499818ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:22:09 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 262.526337ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
490.464335ms
FAIL (2025-07-18 11:21:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 490.490993ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
251.985613ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:21:28 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 252.009466ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
588.576486ms
FAIL (2025-07-18 11:20:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 588.615042ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
251.345357ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:20:46 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.377882ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
247.879428ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:20:13 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 247.908031ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.159651702s
FAIL (2025-07-18 11:20:03 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 1.160137606s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
250.532713ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:19:40 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.559412ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
977.627777ms
FAIL (2025-07-18 11:19:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 977.662951ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
249.215233ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:19:01 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.242775ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
251.129296ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:18:26 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.156567ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
483.513446ms
FAIL (2025-07-18 11:18:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 483.543688ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
250.394436ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:17:42 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.421425ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
474.360691ms
FAIL (2025-07-18 11:17:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 474.520204ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
450.467779ms
FAIL (2025-07-18 11:16:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 450.496639ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
261.555523ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:16:28 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 261.578573ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
496.503172ms
FAIL (2025-07-18 11:15:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 496.539671ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
248.923153ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:15:42 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 248.953154ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
446.280508ms
FAIL (2025-07-18 11:15:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 446.31057ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
252.001417ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:15:10 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 252.038812ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
604.143771ms
FAIL (2025-07-18 11:15:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 604.182712ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
248.858144ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:14:42 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 248.881447ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
252.154872ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:14:23 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 252.177022ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
458.859552ms
FAIL (2025-07-18 11:14:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 458.892114ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
544.148594ms
FAIL (2025-07-18 11:13:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 544.239778ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
249.738323ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:13:34 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.765217ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
449.49153ms
FAIL (2025-07-18 11:13:27 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 449.527392ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
250.070262ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:13:15 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.099004ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
250.517468ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:12:41 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.557068ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
528.056129ms
FAIL (2025-07-18 11:12:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 528.100838ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
249.1273ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:11:46 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.158438ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
550.51558ms
FAIL (2025-07-18 11:11:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 550.541909ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
251.015095ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:11:16 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.040248ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
456.844032ms
FAIL (2025-07-18 11:10:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 456.869524ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
262.916369ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:10:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 262.96655ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
523.829662ms
FAIL (2025-07-18 11:09:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 523.863865ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
253.983117ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:09:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 254.008063ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
564.766893ms
FAIL (2025-07-18 11:08:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 564.7979ms
core
uplink
us-select-1
|