Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
517.485558ms
FAIL (2025-07-18 11:45:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 517.515609ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
494.85593ms
FAIL (2025-07-18 11:45:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 494.884882ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
251.38484ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:44:33 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.426512ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
651.485783ms
FAIL (2025-07-18 11:44:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 651.542196ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
250.591523ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:43:51 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.614903ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
537.375425ms
FAIL (2025-07-18 11:43:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 537.411723ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
263.950567ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:42:57 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 263.97346ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
443.057404ms
FAIL (2025-07-18 11:42:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 443.090093ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
251.661095ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:42:08 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.702488ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
253.707737ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:41:47 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 253.73452ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
613.444739ms
FAIL (2025-07-18 11:41:27 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 613.477871ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
250.987084ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:41:19 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.021909ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
489.2616ms
FAIL (2025-07-18 11:41:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 489.292852ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
279.39456ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:40:55 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 279.420937ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
247.765344ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:40:17 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 247.792903ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
442.819711ms
FAIL (2025-07-18 11:39:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 442.849478ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
259.419311ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:39:19 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 259.482958ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
661.900875ms
FAIL (2025-07-18 11:39:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 661.943412ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
249.551509ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:38:41 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.589953ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
496.303667ms
FAIL (2025-07-18 11:38:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 496.334245ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
250.219047ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:37:40 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.248391ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
447.633114ms
FAIL (2025-07-18 11:37:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 447.660675ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
249.554942ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:36:48 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.575295ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
488.55843ms
FAIL (2025-07-18 11:36:14 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 488.583403ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
250.940847ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:35:57 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.970665ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
551.298885ms
FAIL (2025-07-18 11:35:36 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 551.343759ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
536.034023ms
FAIL (2025-07-18 11:35:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 536.060747ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
249.698251ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:35:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.732285ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
259.50008ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:34:37 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 259.531286ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
580.193757ms
FAIL (2025-07-18 11:34:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 580.228158ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
459.80384ms
FAIL (2025-07-18 11:34:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 459.838618ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
250.34004ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:34:05 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 250.36666ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
511.217254ms
FAIL (2025-07-18 11:33:38 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 511.262007ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
248.50657ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:33:30 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 248.540563ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
480.106838ms
FAIL (2025-07-18 11:33:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 480.153925ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
247.913057ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:32:53 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 247.961461ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
271.01932ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:32:33 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 271.055796ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
503.528286ms
FAIL (2025-07-18 11:32:30 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 503.561184ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
251.429023ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:31:48 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 251.453405ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
253.653876ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:31:31 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 253.692315ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
695.351453ms
FAIL (2025-07-18 11:31:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 695.388092ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
576.562047ms
FAIL (2025-07-18 11:30:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 576.597039ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
248.386934ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:30:39 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 248.422956ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
248.073587ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:29:45 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 248.100056ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
475.895283ms
FAIL (2025-07-18 11:29:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 475.921615ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
247.705493ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:29:19 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 247.732407ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
577.59458ms
FAIL (2025-07-18 11:28:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 577.620164ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
249.12969ms target:
https://eu1.storj.io/login
FAIL (2025-07-18 11:28:11 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 249.155982ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
587.818711ms
FAIL (2025-07-18 11:27:53 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 587.853706ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
820.270571ms
FAIL (2025-07-18 11:27:38 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253492212 (601h47m15.179786897s) [noise=true , address=104.36.82.11:4114 , piece_id=MTCLLOXZEQNT5BENY22DDE35MVI4YU3NTPBGCCWY54KKROPJ2HKQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: <nil>
Jul 18 10:58:48.253654730 (601h47m15.179949419s) [noise=true , address=104.36.82.8:4972 , piece_id=JQW3PJ4SUAYH4ASMXLYAI6WHBPXS2U35YY3G56U5CYCMJJGKZFWQ, seg_pos={0 0}, upload=481562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF
Jul 18 10:58:48.253675833 (601h47m15.179970539s) [seg_pos={0 0}, upload=481562]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 18 10:58:48.253754736 (601h47m15.180049444s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:58:48.253760785 (601h47m15.180055471s) [upload=481562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:58:48.304363955 (601h47m15.230658652s) [upload=481562]: Done uploading segments...
Jul 18 10:58:48.304386684 (601h47m15.23068138s) [upload=481562]: Upload finished. err: <nil>
Jul 18 10:59:39.725893756 (601h48m6.652188443s) [upload=481572]: Starting upload
Jul 18 10:59:39.725973859 (601h48m6.652268545s) [upload=481572]: Done starting upload
Jul 18 10:59:39.726060094 (601h48m6.652354775s) [upload=481572]: Uploading segments...
Jul 18 10:59:39.726359141 (601h48m6.652653832s) [upload=481572]: Got next segment. Inline: false
Jul 18 10:59:39.726417410 (601h48m6.652712087s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 10:59:39.726424131 (601h48m6.652718819s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 10:59:39.766809563 (601h48m6.693104258s) [seg_pos={0 0}, upload=481572]: Begin upload segment...
Jul 18 10:59:39.766890422 (601h48m6.693185119s) [seg_pos={0 0}, upload=481572]: Done begin upload segment.
Jul 18 10:59:39.766956647 (601h48m6.693251342s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767574889 (601h48m6.693869586s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.767978284 (601h48m6.694272975s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768560815 (601h48m6.694855507s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.768787976 (601h48m6.695082662s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769546728 (601h48m6.695841421s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.769633459 (601h48m6.695928151s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770211077 (601h48m6.696505768s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770271681 (601h48m6.696566367s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770657772 (601h48m6.696952465s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.770794578 (601h48m6.697089268s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.771013436 (601h48m6.697308126s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773118250 (601h48m6.699412948s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.773450013 (601h48m6.699744706s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.775143029 (601h48m6.701437704s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.776693125 (601h48m6.702987803s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Uploading piece...
Jul 18 10:59:39.882550933 (601h48m6.808845605s) [upload=481572]: Next returned nil segment
Jul 18 10:59:39.882566717 (601h48m6.80886139s) [upload=481572]: Waiting for error group managing segments...
Jul 18 10:59:39.886925314 (601h48m6.81322001s) [noise=true , address=45.91.116.9:4261 , piece_id=LMRPIFSG72DN3PX22E4Q547IQHG3XUGVXBARJAVTKYXZ7K3F62ZQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.887662605 (601h48m6.813957289s) [noise=true , address=45.91.116.11:4117 , piece_id=V7I2H6GBJY54HSSE5JPDSAX2LPNSTSIZMJZZADEJK7Z7D4WRO4FA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888216632 (601h48m6.814511305s) [noise=true , address=45.91.116.10:4083 , piece_id=35ZWMZ5SQLDS27ETKUWS6J5UIV4B5ZALWBZOLU5DXMJDXCC2KQ4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.888777131 (601h48m6.815071814s) [noise=true , address=45.91.116.14:4189 , piece_id=KSEJDBAMBJBZKU4QLRYMTPMTPNAPQW7YR3632Q62BD54WWYJSTRQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.889366644 (601h48m6.815661319s) [noise=true , address=45.91.116.7:4011 , piece_id=XV3LO4SQPUTC6UKEDMGXIZHWDGL666HLSNIX4MJ5LPOLZG7GYP7A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.890564517 (601h48m6.816859196s) [noise=true , address=77.90.31.11:4554 , piece_id=XMVJPG7TTJNV6G6NQFZX5W6OJRUAKY3AV5BF5HLXERVEMYEOEU4A, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891054719 (601h48m6.817349398s) [noise=true , address=77.90.31.21:4877 , piece_id=MXZ6TN5QHRQ762OW4HLWZ3MLM3R7M7XCR23YE3TN5HLHBC27CYQQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891111988 (601h48m6.817406676s) [noise=true , address=77.90.31.10:4518 , piece_id=NSEE5YCSLKXEKIWTJSRC727WDBVU4XTB2UJRW3M4UHYARKW6RTSQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891523413 (601h48m6.817818087s) [noise=true , address=77.90.31.19:4841 , piece_id=E4E3FPFPBSKRXS4747WV7SYVQOSQ5Y2YQXADTM3QRAIED7QZC46Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.891662215 (601h48m6.817956889s) [noise=true , address=77.90.31.14:4661 , piece_id=W3LTH4OKBBLZS5TXWV4YNRAVUYVAJJUXQUSYGZFXXFZRQPCJEHMA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892064062 (601h48m6.818358742s) [noise=true , address=104.36.82.8:4969 , piece_id=VNKP4GCI3EFTJTKMJG4OZG4H7RKKCBSL2LDAXSZZN4ZXW3WST5NA, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892203830 (601h48m6.818498521s) [noise=true , address=104.36.82.9:4006 , piece_id=ZRDBROYUN3AFMHUGXGHF6CI3IREINVAT4VXHHBQ2CGPTJY6X7S5Q, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892459694 (601h48m6.818754373s) [noise=true , address=77.90.31.16:4733 , piece_id=XWP62HLDXB7QZVM73ONAQQSLZMKFQMYIZ5E5VC3RS542U6HQ65OQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.892469790 (601h48m6.818764467s) [seg_pos={0 0}, upload=481572]: Segment reached optimal threshold of 13 pieces.
Jul 18 10:59:39.893124237 (601h48m6.819418923s) [noise=true , address=104.36.82.9:4005 , piece_id=VGH5J6BGOHNLT4NDMCJDH25XBLUF5PEPXKHXRAV2B75KPMPPEWUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 18 10:59:39.893251824 (601h48m6.819546511s) [noise=true , address=104.36.82.13:4186 , piece_id=2PJTZRUVHO3E6RV2INML2FM2I7DH56L3HXLKK2CLIAJAI5JZYMFQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894292919 (601h48m6.820587607s) [noise=true , address=104.36.82.11:4115 , piece_id=4I3RK4AMIMSKMWGPOQTGUT52QSBOANUIVED6TGZJWTPLK47ITTUQ, seg_pos={0 0}, upload=481572]: Done uploading piece. err: <nil>
Jul 18 10:59:39.894695599 (601h48m6.820990295s) [seg_pos={0 0}, upload=481572]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 18 10:59:39.894967851 (601h48m6.821262542s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 10:59:39.895173549 (601h48m6.821468272s) [upload=481572]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 10:59:39.954053368 (601h48m6.880348067s) [upload=481572]: Done uploading segments...
Jul 18 10:59:39.954078171 (601h48m6.880372862s) [upload=481572]: Upload finished. err: <nil>
Duration: 820.457772ms
core
uplink
us-select-1
|