Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................................................XXX.] duration:
847.900139ms
FAIL (2025-06-25 06:25:42 UTC)
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
2WLUZOKNHJOTOKROWP4YY3FMIJC5MXBMD5CRQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.965579422 (45h13m33.89187412s) [noise=true , address=45.91.116.10:4081 , piece_id=ZRX5JL2SDHZLHYCZUPCOMQAYJR4L2V3KFFZEUTWMZJXEIPAWGXQQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.966861056 (45h13m33.893155753s) [noise=true , address=45.91.116.12:5227 , piece_id=GKX6OV5DVRVESJAM6M7MBQNLULWXGQY5HLDZIVM27UU3HINIB4HA, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.967637432 (45h13m33.893932129s) [noise=true , address=104.36.82.7:4909 , piece_id=H5O7BDH2C4OZZNXQDZMHULFJZLFG3F3E3J64YFSOE6264LYQ3PRQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.968622153 (45h13m33.894916849s) [noise=true , address=77.90.31.15:4698 , piece_id=3XQAGT7DDKO4EU6W4IIBPPDOUGOOH6JYZPHFEGLNFEN4ZEF3N2MQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.969160940 (45h13m33.895455637s) [noise=true , address=45.91.116.5:5297 , piece_id=JYJOZAPJLERLXR4FDQNZGPYVNUV5RBDX536ASHLZNFLVIURUK64A, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.969722201 (45h13m33.896016898s) [noise=true , address=104.36.82.12:4150 , piece_id=CIPRIXF6MTKYHPAIWHPHZURQSDOZKVB5Q33ODZLVVGODKJMA4BRQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.971267136 (45h13m33.897561831s) [noise=true , address=45.91.116.9:5261 , piece_id=SR7WE2CJ55NL24TACF4D7SNJ5OPMV5HEXLNWN46UEZTIODTTDKBA, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.973975937 (45h13m33.900270634s) [noise=true , address=45.91.116.7:4009 , piece_id=INLG4TJ5WAQ4AK23HM4S56JOYLU3QTKPMMCEL2OACT5P3VG446XQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.977444569 (45h13m33.903739259s) [noise=true , address=45.91.116.6:4975 , piece_id=NOYWU54CFIC6WR3PHPIBDMSAUYXYIOILRVZH3KYQNSQKPYCA6I4Q, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.979966838 (45h13m33.906261532s) [noise=true , address=45.91.116.11:4119 , piece_id=JWDCHDU5567YZ3R4PLRFFN2IPLG7BOVZD45VPBVC57R6HVIHJ32Q, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.985254518 (45h13m33.911549213s) [noise=true , address=77.90.31.16:4735 , piece_id=WB2PINNS7NRWK7L7WALOGEP35W35DFMTDLEUSXBLRDBU6GMFC5JQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.989690365 (45h13m33.915985038s) [noise=true , address=104.36.82.2:4730 , piece_id=C2FUFWWZ4M7FLYHP3YICZDY43XW5Q33WV5T5OJ3PAFFC665RB5JQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.992878963 (45h13m33.919173668s) [noise=true , address=77.90.31.11:4555 , piece_id=GSGAU5KRRMWH2ZX5RHRYOBOH5XWD64YFF5J7ZIMSOTUH76WU33LA, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.993873142 (45h13m33.920167832s) [noise=true , address=104.36.82.9:4007 , piece_id=AXF6U5YQMTQ4FTC6N5FHQ5GF523FRWRPZI3J47CAU7WGBA22AOMQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:07.081827309 (45h13m34.008121992s) [upload=36292]: Next returned nil segment
Jun 25 06:25:07.081846644 (45h13m34.008141321s) [upload=36292]: Waiting for error group managing segments...
Jun 25 06:25:07.091339199 (45h13m34.017633886s) [noise=true , address=104.36.82.9:4007 , piece_id=AXF6U5YQMTQ4FTC6N5FHQ5GF523FRWRPZI3J47CAU7WGBA22AOMQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:07.091620012 (45h13m34.017914693s) [noise=true , address=104.36.82.2:4730 , piece_id=C2FUFWWZ4M7FLYHP3YICZDY43XW5Q33WV5T5OJ3PAFFC665RB5JQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:07.092011563 (45h13m34.018306239s) [noise=true , address=104.36.82.12:4150 , piece_id=CIPRIXF6MTKYHPAIWHPHZURQSDOZKVB5Q33ODZLVVGODKJMA4BRQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:07.098034961 (45h13m34.024329637s) [noise=true , address=104.36.82.7:4909 , piece_id=H5O7BDH2C4OZZNXQDZMHULFJZLFG3F3E3J64YFSOE6264LYQ3PRQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:36.770254614 (45h14m3.696549312s) [noise=true , address=45.91.116.5:5297 , piece_id=JYJOZAPJLERLXR4FDQNZGPYVNUV5RBDX536ASHLZNFLVIURUK64A, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:5297): protocol: write tcp 159.223.143.39:57038->45.91.116.5:5297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770344543 (45h14m3.696639233s) [noise=true , address=77.90.31.16:4735 , piece_id=WB2PINNS7NRWK7L7WALOGEP35W35DFMTDLEUSXBLRDBU6GMFC5JQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 159.223.143.39:50774->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770376688 (45h14m3.696671402s) [noise=true , address=45.91.116.9:5261 , piece_id=SR7WE2CJ55NL24TACF4D7SNJ5OPMV5HEXLNWN46UEZTIODTTDKBA, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: rpc: dial tcp 45.91.116.9:5261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770509119 (45h14m3.696803819s) [noise=true , address=77.90.31.19:4842 , piece_id=IKRE5LN6EE3G7HKFYCKJJZOWNIT25QTC5RTVW2Y6UXIGJKAVC75A, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: rpc: dial tcp 77.90.31.19:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770535520 (45h14m3.69683021s) [noise=true , address=77.90.31.11:4553 , piece_id=ZHFZMAAWL4E5KFD2WLUZOKNHJOTOKROWP4YY3FMIJC5MXBMD5CRQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 159.223.143.39:34200->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770589717 (45h14m3.696884407s) [noise=true , address=45.91.116.10:4081 , piece_id=ZRX5JL2SDHZLHYCZUPCOMQAYJR4L2V3KFFZEUTWMZJXEIPAWGXQQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 159.223.143.39:54710->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770603698 (45h14m3.696898388s) [noise=true , address=77.90.31.15:4698 , piece_id=3XQAGT7DDKO4EU6W4IIBPPDOUGOOH6JYZPHFEGLNFEN4ZEF3N2MQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770668501 (45h14m3.69696319s) [noise=true , address=45.91.116.6:4975 , piece_id=NOYWU54CFIC6WR3PHPIBDMSAUYXYIOILRVZH3KYQNSQKPYCA6I4Q, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770681314 (45h14m3.696976002s) [noise=true , address=45.91.116.11:4119 , piece_id=JWDCHDU5567YZ3R4PLRFFN2IPLG7BOVZD45VPBVC57R6HVIHJ32Q, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:60876->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770735699 (45h14m3.697030391s) [noise=true , address=77.90.31.11:4555 , piece_id=GSGAU5KRRMWH2ZX5RHRYOBOH5XWD64YFF5J7ZIMSOTUH76WU33LA, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 159.223.143.39:39044->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770761378 (45h14m3.697056067s) [noise=true , address=45.91.116.12:5227 , piece_id=GKX6OV5DVRVESJAM6M7MBQNLULWXGQY5HLDZIVM27UU3HINIB4HA, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:5227): protocol: write tcp 159.223.143.39:52044->45.91.116.12:5227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770771668 (45h14m3.697066369s) [noise=true , address=45.91.116.7:4009 , piece_id=INLG4TJ5WAQ4AK23HM4S56JOYLU3QTKPMMCEL2OACT5P3VG446XQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 159.223.143.39:50972->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770793225 (45h14m3.697087925s) [seg_pos={0 0}, upload=36292]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Jun 25 06:25:36.807855113 (45h14m3.734149801s) [upload=36292]: Done uploading segments...
Jun 25 06:25:36.807886310 (45h14m3.734199715s) [upload=36292]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 847.925633ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
30.043497567s
FAIL (2025-06-25 06:25:36 UTC)
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
2WLUZOKNHJOTOKROWP4YY3FMIJC5MXBMD5CRQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.965579422 (45h13m33.89187412s) [noise=true , address=45.91.116.10:4081 , piece_id=ZRX5JL2SDHZLHYCZUPCOMQAYJR4L2V3KFFZEUTWMZJXEIPAWGXQQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.966861056 (45h13m33.893155753s) [noise=true , address=45.91.116.12:5227 , piece_id=GKX6OV5DVRVESJAM6M7MBQNLULWXGQY5HLDZIVM27UU3HINIB4HA, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.967637432 (45h13m33.893932129s) [noise=true , address=104.36.82.7:4909 , piece_id=H5O7BDH2C4OZZNXQDZMHULFJZLFG3F3E3J64YFSOE6264LYQ3PRQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.968622153 (45h13m33.894916849s) [noise=true , address=77.90.31.15:4698 , piece_id=3XQAGT7DDKO4EU6W4IIBPPDOUGOOH6JYZPHFEGLNFEN4ZEF3N2MQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.969160940 (45h13m33.895455637s) [noise=true , address=45.91.116.5:5297 , piece_id=JYJOZAPJLERLXR4FDQNZGPYVNUV5RBDX536ASHLZNFLVIURUK64A, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.969722201 (45h13m33.896016898s) [noise=true , address=104.36.82.12:4150 , piece_id=CIPRIXF6MTKYHPAIWHPHZURQSDOZKVB5Q33ODZLVVGODKJMA4BRQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.971267136 (45h13m33.897561831s) [noise=true , address=45.91.116.9:5261 , piece_id=SR7WE2CJ55NL24TACF4D7SNJ5OPMV5HEXLNWN46UEZTIODTTDKBA, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.973975937 (45h13m33.900270634s) [noise=true , address=45.91.116.7:4009 , piece_id=INLG4TJ5WAQ4AK23HM4S56JOYLU3QTKPMMCEL2OACT5P3VG446XQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.977444569 (45h13m33.903739259s) [noise=true , address=45.91.116.6:4975 , piece_id=NOYWU54CFIC6WR3PHPIBDMSAUYXYIOILRVZH3KYQNSQKPYCA6I4Q, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.979966838 (45h13m33.906261532s) [noise=true , address=45.91.116.11:4119 , piece_id=JWDCHDU5567YZ3R4PLRFFN2IPLG7BOVZD45VPBVC57R6HVIHJ32Q, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.985254518 (45h13m33.911549213s) [noise=true , address=77.90.31.16:4735 , piece_id=WB2PINNS7NRWK7L7WALOGEP35W35DFMTDLEUSXBLRDBU6GMFC5JQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.989690365 (45h13m33.915985038s) [noise=true , address=104.36.82.2:4730 , piece_id=C2FUFWWZ4M7FLYHP3YICZDY43XW5Q33WV5T5OJ3PAFFC665RB5JQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.992878963 (45h13m33.919173668s) [noise=true , address=77.90.31.11:4555 , piece_id=GSGAU5KRRMWH2ZX5RHRYOBOH5XWD64YFF5J7ZIMSOTUH76WU33LA, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:06.993873142 (45h13m33.920167832s) [noise=true , address=104.36.82.9:4007 , piece_id=AXF6U5YQMTQ4FTC6N5FHQ5GF523FRWRPZI3J47CAU7WGBA22AOMQ, seg_pos={0 0}, upload=36292]: Uploading piece...
Jun 25 06:25:07.081827309 (45h13m34.008121992s) [upload=36292]: Next returned nil segment
Jun 25 06:25:07.081846644 (45h13m34.008141321s) [upload=36292]: Waiting for error group managing segments...
Jun 25 06:25:07.091339199 (45h13m34.017633886s) [noise=true , address=104.36.82.9:4007 , piece_id=AXF6U5YQMTQ4FTC6N5FHQ5GF523FRWRPZI3J47CAU7WGBA22AOMQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:07.091620012 (45h13m34.017914693s) [noise=true , address=104.36.82.2:4730 , piece_id=C2FUFWWZ4M7FLYHP3YICZDY43XW5Q33WV5T5OJ3PAFFC665RB5JQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:07.092011563 (45h13m34.018306239s) [noise=true , address=104.36.82.12:4150 , piece_id=CIPRIXF6MTKYHPAIWHPHZURQSDOZKVB5Q33ODZLVVGODKJMA4BRQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:07.098034961 (45h13m34.024329637s) [noise=true , address=104.36.82.7:4909 , piece_id=H5O7BDH2C4OZZNXQDZMHULFJZLFG3F3E3J64YFSOE6264LYQ3PRQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: <nil>
Jun 25 06:25:36.770254614 (45h14m3.696549312s) [noise=true , address=45.91.116.5:5297 , piece_id=JYJOZAPJLERLXR4FDQNZGPYVNUV5RBDX536ASHLZNFLVIURUK64A, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:5297): protocol: write tcp 159.223.143.39:57038->45.91.116.5:5297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770344543 (45h14m3.696639233s) [noise=true , address=77.90.31.16:4735 , piece_id=WB2PINNS7NRWK7L7WALOGEP35W35DFMTDLEUSXBLRDBU6GMFC5JQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 159.223.143.39:50774->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770376688 (45h14m3.696671402s) [noise=true , address=45.91.116.9:5261 , piece_id=SR7WE2CJ55NL24TACF4D7SNJ5OPMV5HEXLNWN46UEZTIODTTDKBA, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:5261): protocol: rpc: dial tcp 45.91.116.9:5261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770509119 (45h14m3.696803819s) [noise=true , address=77.90.31.19:4842 , piece_id=IKRE5LN6EE3G7HKFYCKJJZOWNIT25QTC5RTVW2Y6UXIGJKAVC75A, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: rpc: dial tcp 77.90.31.19:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770535520 (45h14m3.69683021s) [noise=true , address=77.90.31.11:4553 , piece_id=ZHFZMAAWL4E5KFD2WLUZOKNHJOTOKROWP4YY3FMIJC5MXBMD5CRQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 159.223.143.39:34200->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770589717 (45h14m3.696884407s) [noise=true , address=45.91.116.10:4081 , piece_id=ZRX5JL2SDHZLHYCZUPCOMQAYJR4L2V3KFFZEUTWMZJXEIPAWGXQQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 159.223.143.39:54710->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770603698 (45h14m3.696898388s) [noise=true , address=77.90.31.15:4698 , piece_id=3XQAGT7DDKO4EU6W4IIBPPDOUGOOH6JYZPHFEGLNFEN4ZEF3N2MQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770668501 (45h14m3.69696319s) [noise=true , address=45.91.116.6:4975 , piece_id=NOYWU54CFIC6WR3PHPIBDMSAUYXYIOILRVZH3KYQNSQKPYCA6I4Q, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770681314 (45h14m3.696976002s) [noise=true , address=45.91.116.11:4119 , piece_id=JWDCHDU5567YZ3R4PLRFFN2IPLG7BOVZD45VPBVC57R6HVIHJ32Q, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:60876->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770735699 (45h14m3.697030391s) [noise=true , address=77.90.31.11:4555 , piece_id=GSGAU5KRRMWH2ZX5RHRYOBOH5XWD64YFF5J7ZIMSOTUH76WU33LA, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 159.223.143.39:39044->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770761378 (45h14m3.697056067s) [noise=true , address=45.91.116.12:5227 , piece_id=GKX6OV5DVRVESJAM6M7MBQNLULWXGQY5HLDZIVM27UU3HINIB4HA, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:5227): protocol: write tcp 159.223.143.39:52044->45.91.116.12:5227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770771668 (45h14m3.697066369s) [noise=true , address=45.91.116.7:4009 , piece_id=INLG4TJ5WAQ4AK23HM4S56JOYLU3QTKPMMCEL2OACT5P3VG446XQ, seg_pos={0 0}, upload=36292]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 159.223.143.39:50972->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:25:36.770793225 (45h14m3.697087925s) [seg_pos={0 0}, upload=36292]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Jun 25 06:25:36.807855113 (45h14m3.734149801s) [upload=36292]: Done uploading segments...
Jun 25 06:25:36.807886310 (45h14m3.734199715s) [upload=36292]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 30.043522918s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.055957602s
FAIL (2025-06-25 06:24:23 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
segment...
Jun 25 06:23:53.065839057 (45h12m19.992133752s) [seg_pos={0 0}, upload=36276]: Done begin upload segment.
Jun 25 06:23:53.065879853 (45h12m19.992174554s) [noise=true , address=45.91.116.8:4048 , piece_id=PT5XMIAJ3D6UB5WT53KWERU7JHTWKEWTE3SJ734Q6737F3RIVG6A, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.066466666 (45h12m19.992761367s) [noise=true , address=104.36.82.8:4969 , piece_id=GP4BZRZZ6A7SIIZI5KL2T3YXSGUDRHT2AACJLHKJWRGWQ5GXOD7A, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.066999434 (45h12m19.993294133s) [noise=true , address=45.91.116.11:4118 , piece_id=J2MKXMD4VUTXGH3T6OJTTCMEJGIXNPFRIEJABS2YLS4OFXVYXGXA, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.067068385 (45h12m19.993363084s) [noise=true , address=45.91.116.4:4939 , piece_id=56VJ77K4HSYLV4GGL67TALS5TZYPN7NN5RUIP7JGXSBCPSZJP2CQ, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.068065703 (45h12m19.994360402s) [noise=true , address=45.91.116.6:4974 , piece_id=N2UQ3DWUCQJI7HKKIZERCKHJ7TUHIXYC422KSRWHE4BAPTHVBNOQ, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.068833523 (45h12m19.99512822s) [noise=true , address=104.36.82.7:4911 , piece_id=BRLVINVKKUFDI3GWLI4FTNHZ2EKNR45P5ZE3JB3HHBL36OAG6MZQ, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.069315437 (45h12m19.995610134s) [noise=true , address=77.90.31.18:4807 , piece_id=FPKD76YEWDMUTGBPKXFMJIGJKWS6G5MC5IXAFJ2U77JZAI6XRHVA, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.070435870 (45h12m19.996730573s) [noise=true , address=104.36.82.3:4767 , piece_id=P5IQP6GYOMC6ENY4SN3WKT4RP52PTBR243MU5NGIEKLS6666VQUA, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.072055796 (45h12m19.998350486s) [noise=true , address=104.36.82.9:4005 , piece_id=TZCHOTFLQ43X3QPUCEOSHCW6QCOS7DBENCEPJXYF5G4KGGLPZZKQ, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.073113103 (45h12m19.999407794s) [noise=true , address=45.91.116.7:4009 , piece_id=PNUFUF75NNBIAY5P5R6L4X4GS7UWWI5NYPLCH2QQR2ZXVZI7F2HA, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.073943797 (45h12m20.000238492s) [noise=true , address=45.91.116.9:5262 , piece_id=HC2O4BCSRMZJIH7KEVAX4VXYIPZWJVZBIIP62YOPKW5WIEXZEQ6Q, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.074331352 (45h12m20.000626047s) [noise=true , address=77.90.31.21:4878 , piece_id=CWNUDUALJFOQC4F72UDBSP2LE7EA7HJJ5GW3Z77TC2BZGQOZQTQQ, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.074652990 (45h12m20.000947679s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAJHOK4T42ZYL3G2JQB3LJXIGMILOIK2ULY5RC4JW2PUG7436EA, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.074928125 (45h12m20.001222818s) [noise=true , address=77.90.31.10:4520 , piece_id=YH7EXMGMAQGHR4H2L2SB6PBQR64QEG7NXYKVSRWGYODIAOSDRHQQ, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.075895900 (45h12m20.002190597s) [noise=true , address=45.91.116.12:5226 , piece_id=Y37H3STCNP5N6VWC52OOQR3AI4PLYVMPZVRFASQOP44VT67ETLQA, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.076903755 (45h12m20.00319845s) [noise=true , address=77.90.31.11:4554 , piece_id=SD7KBICCA6S5EHJU2HD2DKK632IRFYWKS3WNU6L7LBOTCBJEDS4A, seg_pos={0 0}, upload=36276]: Uploading piece...
Jun 25 06:23:53.151167828 (45h12m20.077462508s) [upload=36276]: Next returned nil segment
Jun 25 06:23:53.151184247 (45h12m20.077478927s) [upload=36276]: Waiting for error group managing segments...
Jun 25 06:23:53.158925105 (45h12m20.085219786s) [noise=true , address=104.36.82.9:4005 , piece_id=TZCHOTFLQ43X3QPUCEOSHCW6QCOS7DBENCEPJXYF5G4KGGLPZZKQ, seg_pos={0 0}, upload=36276]: Done uploading piece. err: <nil>
Jun 25 06:23:53.160356664 (45h12m20.08665134s) [noise=true , address=104.36.82.7:4911 , piece_id=BRLVINVKKUFDI3GWLI4FTNHZ2EKNR45P5ZE3JB3HHBL36OAG6MZQ, seg_pos={0 0}, upload=36276]: Done uploading piece. err: <nil>
Jun 25 06:23:53.160869802 (45h12m20.087164475s) [noise=true , address=104.36.82.3:4767 , piece_id=P5IQP6GYOMC6ENY4SN3WKT4RP52PTBR243MU5NGIEKLS6666VQUA, seg_pos={0 0}, upload=36276]: Done uploading piece. err: <nil>
Jun 25 06:23:53.161450055 (45h12m20.087744731s) [noise=true , address=104.36.82.8:4969 , piece_id=GP4BZRZZ6A7SIIZI5KL2T3YXSGUDRHT2AACJLHKJWRGWQ5GXOD7A, seg_pos={0 0}, upload=36276]: Done uploading piece. err: <nil>
Jun 25 06:23:53.221653276 (45h12m20.147947964s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAJHOK4T42ZYL3G2JQB3LJXIGMILOIK2ULY5RC4JW2PUG7436EA, seg_pos={0 0}, upload=36276]: Done uploading piece. err: <nil>
Jun 25 06:24:22.998656471 (45h12m49.924951159s) [noise=true , address=45.91.116.7:4009 , piece_id=PNUFUF75NNBIAY5P5R6L4X4GS7UWWI5NYPLCH2QQR2ZXVZI7F2HA, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: rpc: dial tcp 45.91.116.7:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.998758551 (45h12m49.925053237s) [noise=true , address=45.91.116.9:5262 , piece_id=HC2O4BCSRMZJIH7KEVAX4VXYIPZWJVZBIIP62YOPKW5WIEXZEQ6Q, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:5262): protocol: rpc: dial tcp 45.91.116.9:5262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.998816379 (45h12m49.925111054s) [noise=true , address=77.90.31.21:4878 , piece_id=CWNUDUALJFOQC4F72UDBSP2LE7EA7HJJ5GW3Z77TC2BZGQOZQTQQ, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 159.223.143.39:34238->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.998870393 (45h12m49.925165079s) [noise=true , address=45.91.116.12:5226 , piece_id=Y37H3STCNP5N6VWC52OOQR3AI4PLYVMPZVRFASQOP44VT67ETLQA, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.998920510 (45h12m49.925215196s) [noise=true , address=45.91.116.6:4974 , piece_id=N2UQ3DWUCQJI7HKKIZERCKHJ7TUHIXYC422KSRWHE4BAPTHVBNOQ, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: rpc: dial tcp 45.91.116.6:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.998966461 (45h12m49.925261223s) [noise=true , address=45.91.116.8:4048 , piece_id=PT5XMIAJ3D6UB5WT53KWERU7JHTWKEWTE3SJ734Q6737F3RIVG6A, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: rpc: dial tcp 45.91.116.8:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.999071367 (45h12m49.925366056s) [noise=true , address=45.91.116.4:4939 , piece_id=56VJ77K4HSYLV4GGL67TALS5TZYPN7NN5RUIP7JGXSBCPSZJP2CQ, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: rpc: dial tcp 45.91.116.4:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.999079699 (45h12m49.925374385s) [noise=true , address=77.90.31.18:4807 , piece_id=FPKD76YEWDMUTGBPKXFMJIGJKWS6G5MC5IXAFJ2U77JZAI6XRHVA, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: rpc: dial tcp 77.90.31.18:4807: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.999135667 (45h12m49.925430353s) [noise=true , address=77.90.31.10:4520 , piece_id=YH7EXMGMAQGHR4H2L2SB6PBQR64QEG7NXYKVSRWGYODIAOSDRHQQ, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.999163694 (45h12m49.925458379s) [noise=true , address=45.91.116.11:4118 , piece_id=J2MKXMD4VUTXGH3T6OJTTCMEJGIXNPFRIEJABS2YLS4OFXVYXGXA, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: rpc: dial tcp 45.91.116.11:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.999211759 (45h12m49.92550645s) [noise=true , address=77.90.31.11:4554 , piece_id=SD7KBICCA6S5EHJU2HD2DKK632IRFYWKS3WNU6L7LBOTCBJEDS4A, seg_pos={0 0}, upload=36276]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 159.223.143.39:44812->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:24:22.999249658 (45h12m49.925544354s) [seg_pos={0 0}, upload=36276]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Jun 25 06:24:23.052821079 (45h12m49.979115755s) [upload=36276]: Done uploading segments...
Jun 25 06:24:23.052850102 (45h12m49.979144796s) [upload=36276]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 30.055999205s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.036610559s
FAIL (2025-06-25 06:23:39 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
83 (45h11m35.98989378s) [noise=true , address=104.36.82.3:4765 , piece_id=QUVHKZR2KPMVO7A5ZNYOGKF342QB2B3NYXOCWGJ4AVLMHIQBH7KA, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.063659316 (45h11m35.989954015s) [noise=true , address=45.91.116.8:4048 , piece_id=IULCLE7NVOQF6CID32CCM47STGZTU3CSRMH7RFQCBXMHKP2BUDRQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.064121970 (45h11m35.990416671s) [noise=true , address=45.91.116.7:4009 , piece_id=6WFYR3DSBSHYG2XNJ4LF3FEJEYL2EQWPDHGG6K3XBM7VEBXQBMWA, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.065289849 (45h11m35.991584554s) [noise=true , address=77.90.31.12:4590 , piece_id=4DDX5IMT2XMGELNUQ6EMOQ74RE34LDID526IQNMHT2CM3BAO3GXQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.065926644 (45h11m35.992221342s) [noise=true , address=45.91.116.9:5262 , piece_id=CQSBSEMNI6GNQKDOGXGJYVJ4T5JDBDGMFD4S77K4MQYWSMZA3MKQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.066656463 (45h11m35.99295116s) [noise=true , address=45.91.116.6:4973 , piece_id=JDSONLSWO4P43VCPTNM4SHVAKP636VDVFLPUWCRAZ7TXS2T5BOOQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.066793531 (45h11m35.993088228s) [noise=true , address=45.91.116.10:4083 , piece_id=NP6X4GAAZBXYICAIHLFDOP33GIIY7RSUGK7MAXZDFQ5XRDW3NB2A, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.067365534 (45h11m35.993660231s) [noise=true , address=104.36.82.3:4767 , piece_id=BJPZNGFE62DQWBJFFVPRARVPVYPV3MK4C3DIOWCSR7SRLUUOISGA, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.067748673 (45h11m35.994043366s) [noise=true , address=45.91.116.13:4154 , piece_id=I3LVG2YRYONQPLNPIYA6DFN4TY4UHUF7MOLJUNVAEB3PVRCYR4MQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.068111810 (45h11m35.994406501s) [noise=true , address=104.36.82.6:5875 , piece_id=5XRW5NMVV5GOYYKCHYF5EMHJFL7KAHDI4RWE3VCJM654PGZ2CXFQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.068450134 (45h11m35.994744828s) [noise=true , address=104.36.82.13:4186 , piece_id=NOB6QOFNCOEL25STS5HIMDRVF53ZQ2XICQXIINPEIAEIOSDM277Q, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.068775569 (45h11m35.995070265s) [noise=true , address=104.36.82.15:4258 , piece_id=ESLSOTI4QXRPUQYR2FLY7Y5H3GYC3CKCEFEPLLNFSPHFVUO7RORQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.069163915 (45h11m35.995458622s) [noise=true , address=77.90.31.16:4733 , piece_id=LZM5RHW4JZC2MDAVH52VN5HTRKKPXT3I2EIPKU3P2CVOO3W5DFFA, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.069547431 (45h11m35.995842121s) [noise=true , address=77.90.31.17:4772 , piece_id=LJ646A2SCVSJ3KT3PPQEQ7Q2JNEES3J2ZD3LOMUPFWTP2YOHK4EQ, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.070007523 (45h11m35.996302219s) [noise=true , address=45.91.116.5:5297 , piece_id=X7NJMGHQX26PVMHFCXTJ4PUJA7DYBS6ZEG2AB5KUMIRHTZGO4HQA, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.070233223 (45h11m35.996527922s) [noise=true , address=45.91.116.4:4938 , piece_id=XNBSOZLHBEJGQLOOLA7VKLQPZZYOYVLXCTHJZ4TRGE4J3HSZ3SAA, seg_pos={0 0}, upload=36269]: Uploading piece...
Jun 25 06:23:09.159331589 (45h11m36.085626282s) [upload=36269]: Next returned nil segment
Jun 25 06:23:09.159354170 (45h11m36.08564887s) [upload=36269]: Waiting for error group managing segments...
Jun 25 06:23:09.166019055 (45h11m36.092313748s) [noise=true , address=104.36.82.6:5875 , piece_id=5XRW5NMVV5GOYYKCHYF5EMHJFL7KAHDI4RWE3VCJM654PGZ2CXFQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: <nil>
Jun 25 06:23:09.167968421 (45h11m36.094263116s) [noise=true , address=104.36.82.3:4767 , piece_id=BJPZNGFE62DQWBJFFVPRARVPVYPV3MK4C3DIOWCSR7SRLUUOISGA, seg_pos={0 0}, upload=36269]: Done uploading piece. err: <nil>
Jun 25 06:23:09.168028075 (45h11m36.094322751s) [noise=true , address=104.36.82.13:4186 , piece_id=NOB6QOFNCOEL25STS5HIMDRVF53ZQ2XICQXIINPEIAEIOSDM277Q, seg_pos={0 0}, upload=36269]: Done uploading piece. err: <nil>
Jun 25 06:23:09.171833111 (45h11m36.098127803s) [noise=true , address=104.36.82.3:4765 , piece_id=QUVHKZR2KPMVO7A5ZNYOGKF342QB2B3NYXOCWGJ4AVLMHIQBH7KA, seg_pos={0 0}, upload=36269]: Done uploading piece. err: <nil>
Jun 25 06:23:09.173467447 (45h11m36.099762129s) [noise=true , address=104.36.82.15:4258 , piece_id=ESLSOTI4QXRPUQYR2FLY7Y5H3GYC3CKCEFEPLLNFSPHFVUO7RORQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: <nil>
Jun 25 06:23:39.000306868 (45h12m5.92660158s) [noise=true , address=45.91.116.7:4009 , piece_id=6WFYR3DSBSHYG2XNJ4LF3FEJEYL2EQWPDHGG6K3XBM7VEBXQBMWA, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: rpc: dial tcp 45.91.116.7:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000384996 (45h12m5.926679775s) [noise=true , address=45.91.116.8:4048 , piece_id=IULCLE7NVOQF6CID32CCM47STGZTU3CSRMH7RFQCBXMHKP2BUDRQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 159.223.143.39:54444->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000447978 (45h12m5.926742686s) [noise=true , address=77.90.31.12:4590 , piece_id=4DDX5IMT2XMGELNUQ6EMOQ74RE34LDID526IQNMHT2CM3BAO3GXQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: rpc: dial tcp 77.90.31.12:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000455255 (45h12m5.926749942s) [noise=true , address=45.91.116.5:5297 , piece_id=X7NJMGHQX26PVMHFCXTJ4PUJA7DYBS6ZEG2AB5KUMIRHTZGO4HQA, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:5297): protocol: write tcp 159.223.143.39:33370->45.91.116.5:5297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000517451 (45h12m5.926812138s) [noise=true , address=45.91.116.6:4973 , piece_id=JDSONLSWO4P43VCPTNM4SHVAKP636VDVFLPUWCRAZ7TXS2T5BOOQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 159.223.143.39:58768->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000523692 (45h12m5.926818398s) [noise=true , address=45.91.116.9:5262 , piece_id=CQSBSEMNI6GNQKDOGXGJYVJ4T5JDBDGMFD4S77K4MQYWSMZA3MKQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:5262): protocol: rpc: dial tcp 45.91.116.9:5262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000572437 (45h12m5.926867122s) [noise=true , address=45.91.116.10:4083 , piece_id=NP6X4GAAZBXYICAIHLFDOP33GIIY7RSUGK7MAXZDFQ5XRDW3NB2A, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 159.223.143.39:50524->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000591683 (45h12m5.926886394s) [noise=true , address=77.90.31.17:4772 , piece_id=LJ646A2SCVSJ3KT3PPQEQ7Q2JNEES3J2ZD3LOMUPFWTP2YOHK4EQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000633132 (45h12m5.926927821s) [noise=true , address=45.91.116.13:4154 , piece_id=I3LVG2YRYONQPLNPIYA6DFN4TY4UHUF7MOLJUNVAEB3PVRCYR4MQ, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 159.223.143.39:51238->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000653553 (45h12m5.926948241s) [noise=true , address=45.91.116.4:4938 , piece_id=XNBSOZLHBEJGQLOOLA7VKLQPZZYOYVLXCTHJZ4TRGE4J3HSZ3SAA, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000694722 (45h12m5.926989409s) [noise=true , address=77.90.31.16:4733 , piece_id=LZM5RHW4JZC2MDAVH52VN5HTRKKPXT3I2EIPKU3P2CVOO3W5DFFA, seg_pos={0 0}, upload=36269]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 159.223.143.39:54414->77.90.31.16:4733: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 25 06:23:39.000759424 (45h12m5.927054123s) [seg_pos={0 0}, upload=36269]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Jun 25 06:23:39.035079799 (45h12m5.961374477s) [upload=36269]: Done uploading segments...
Jun 25 06:23:39.035104992 (45h12m5.961399664s) [upload=36269]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 30.036632787s
core
uplink
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
196.005107ms
FAIL (2025-06-25 05:43:06 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 196.032911ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
163.442452ms
FAIL (2025-06-25 05:41:56 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 163.491065ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
151.738714ms
FAIL (2025-06-25 05:41:32 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 151.782518ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
179.414099ms
FAIL (2025-06-25 05:40:30 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 179.507152ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
182.757373ms
FAIL (2025-06-25 05:39:34 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 182.77431ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
170.120521ms
FAIL (2025-06-25 05:38:41 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 170.147853ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
221.18242ms
FAIL (2025-06-25 05:37:52 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 221.207491ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
249.116539ms
FAIL (2025-06-25 05:36:52 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 249.148651ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
169.312008ms
FAIL (2025-06-25 05:36:04 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 169.346446ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
179.223832ms
FAIL (2025-06-25 05:35:30 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 179.253568ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
196.695897ms
FAIL (2025-06-25 05:35:10 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 196.727597ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
216.693611ms
FAIL (2025-06-25 05:33:56 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 216.724153ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
208.174841ms
FAIL (2025-06-25 05:32:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 208.202775ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
176.090292ms
FAIL (2025-06-25 05:31:37 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 176.119262ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
135.29085ms
FAIL (2025-06-25 05:30:52 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 135.318369ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
212.977831ms
FAIL (2025-06-25 05:29:48 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 213.021223ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
196.911564ms
FAIL (2025-06-25 05:28:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 196.941856ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
161.160576ms
FAIL (2025-06-25 05:28:17 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 161.18491ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
246.875791ms
FAIL (2025-06-25 05:27:15 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 246.934091ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
136.780057ms
FAIL (2025-06-25 05:26:10 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 136.808126ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
250.121677ms
FAIL (2025-06-25 05:25:11 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 250.152893ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
135.105548ms
FAIL (2025-06-25 05:24:39 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 135.130821ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
198.110565ms
FAIL (2025-06-25 05:23:39 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 198.144953ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
168.056013ms
FAIL (2025-06-25 05:23:00 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 168.161855ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
156.933587ms
FAIL (2025-06-25 05:22:23 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 156.982409ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
241.781577ms
FAIL (2025-06-25 05:21:08 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 241.814377ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
159.85301ms
FAIL (2025-06-25 05:20:05 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 159.923565ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
205.265887ms
FAIL (2025-06-25 05:18:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 205.295484ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
154.335504ms
FAIL (2025-06-25 05:18:26 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 154.369792ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
193.464259ms
FAIL (2025-06-25 05:17:53 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 193.547553ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
160.480845ms
FAIL (2025-06-25 05:17:06 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 160.498619ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
159.372367ms
FAIL (2025-06-25 05:16:37 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 159.395423ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
168.249991ms
FAIL (2025-06-25 05:16:11 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 168.366949ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
143.694437ms
FAIL (2025-06-25 05:15:52 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 143.721028ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
206.891259ms
FAIL (2025-06-25 05:14:55 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 206.914916ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
142.919939ms
FAIL (2025-06-25 05:14:33 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 142.949551ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
217.6711ms
FAIL (2025-06-25 05:14:02 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 217.703349ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
149.386206ms
FAIL (2025-06-25 05:12:59 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 149.413553ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
385.606479ms
FAIL (2025-06-25 05:12:04 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 385.639041ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
217.084487ms
FAIL (2025-06-25 05:11:10 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 217.119766ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
413.561634ms
FAIL (2025-06-25 05:10:01 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 413.588738ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
239.748642ms
FAIL (2025-06-25 05:08:54 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 239.857117ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
158.386545ms
FAIL (2025-06-25 05:08:22 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 158.420528ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
162.803953ms
FAIL (2025-06-25 05:07:10 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 162.827589ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
347.576201ms
FAIL (2025-06-25 05:06:05 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 347.706731ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
153.585715ms
FAIL (2025-06-25 05:05:27 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 153.627153ms
edge
authservice
http
bgp
us1
|