Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
11.267593007s
FAIL (2025-07-09 20:52:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload=316819]: Done starting upload
Jul 9 20:51:01.744640664 (395h39m28.670935357s) [upload=316819]: Uploading segments...
Jul 9 20:51:01.745376443 (395h39m28.671671133s) [upload=316819]: Got next segment. Inline: false
Jul 9 20:51:01.745525760 (395h39m28.67182045s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 9 20:51:01.745533412 (395h39m28.671828085s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 9 20:51:01.783911087 (395h39m28.710205769s) [seg_pos={0 0}, upload=316819]: Begin upload segment...
Jul 9 20:51:01.783977239 (395h39m28.710271934s) [seg_pos={0 0}, upload=316819]: Done begin upload segment.
Jul 9 20:51:01.784009016 (395h39m28.710303716s) [noise=true , address=45.91.95.2:4009 , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.784481955 (395h39m28.710776649s) [noise=true , address=77.90.31.14:4678 , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.784908723 (395h39m28.711203414s) [noise=true , address=77.90.31.11:4578 , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.785241082 (395h39m28.711535772s) [noise=true , address=77.90.31.17:4784 , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.785533991 (395h39m28.711828684s) [noise=true , address=77.90.31.15:4709 , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.785835130 (395h39m28.71212983s) [noise=true , address=45.91.116.5:4315 , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.786163209 (395h39m28.712457905s) [noise=true , address=45.91.95.4:4001 , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.786710678 (395h39m28.713005376s) [noise=true , address=45.91.95.3:4033 , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.787413905 (395h39m28.713708604s) [noise=true , address=104.36.82.3:4782 , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.788027996 (395h39m28.714322693s) [noise=true , address=77.90.31.13:4632 , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.788820165 (395h39m28.715114861s) [noise=true , address=104.36.82.44:4892 , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.789282608 (395h39m28.715577305s) [noise=true , address=45.91.95.5:4012 , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.789720674 (395h39m28.716015375s) [noise=true , address=77.90.31.21:4880 , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.790132999 (395h39m28.716427699s) [noise=true , address=104.36.82.6:4906 , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.790759994 (395h39m28.71705469s) [noise=true , address=104.36.82.23:4464 , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.795058621 (395h39m28.721353314s) [noise=true , address=77.90.31.10:4523 , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.795650095 (395h39m28.721944823s) [noise=true , address=104.36.82.19:4403 , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.798606176 (395h39m28.724900871s) [noise=true , address=77.90.31.19:4860 , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.909993379 (395h39m28.836288058s) [upload=316819]: Next returned nil segment
Jul 9 20:51:01.910016191 (395h39m28.83631089s) [upload=316819]: Waiting for error group managing segments...
Jul 9 20:51:01.919116414 (395h39m28.845411096s) [noise=true , address=77.90.31.14:4678 , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.919780312 (395h39m28.846074986s) [noise=true , address=77.90.31.11:4578 , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.920354582 (395h39m28.846649276s) [noise=true , address=77.90.31.21:4880 , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.921019660 (395h39m28.847314356s) [noise=true , address=77.90.31.17:4784 , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.922603097 (395h39m28.848897786s) [noise=true , address=77.90.31.13:4632 , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.932689000 (395h39m28.858983677s) [noise=true , address=77.90.31.19:4860 , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.934674660 (395h39m28.86096935s) [noise=true , address=77.90.31.15:4709 , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.936194700 (395h39m28.862489378s) [noise=true , address=77.90.31.10:4523 , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:02.795832904 (395h39m29.722127608s) [noise=true , address=45.91.95.2:4009 , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:1SrEo4XQ8dBq87CWMuQvExnt7TuL9JbwXqFSehpJ6pPsCHBAi6, address:45.91.95.2:4009): protocol: storage node overloaded, request limit: 2000
Jul 9 20:51:03.997629008 (395h39m30.923923684s) [noise=true , address=45.91.95.3:4033 , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12p7yU1B5SZNrV43Fd8jJr2FSykKDV1QsVgTCNgcBMtB46DazUD, address:45.91.95.3:4033): protocol: storage node overloaded, request limit: 2000
Jul 9 20:51:04.680596617 (395h39m31.606891297s) [noise=true , address=45.91.116.5:4315 , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:06.998485262 (395h39m33.924779955s) [noise=true , address=45.91.95.5:4012 , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:121sqZ4w3zPsKS2g6ufEhdqzBnZcws9558iAfpfrKxdEm6LhA5S, address:45.91.95.5:4012): protocol: storage node overloaded, request limit: 2000
Jul 9 20:51:22.922410916 (395h39m49.848705597s) [noise=true , address=104.36.82.23:4464 , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:29.420748222 (395h39m56.347042898s) [noise=true , address=45.91.95.4:4001 , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:31.417155305 (395h39m58.343450001s) [noise=true , address=104.36.82.6:4906 , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:42.331922832 (395h40m9.258217513s) [noise=true , address=104.36.82.3:4782 , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:52:01.708814311 (395h40m28.635109007s) [noise=true , address=104.36.82.19:4403 , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:104.36.82.19:4403): protocol: expected piece hash; context deadline exceeded; EOF
Jul 9 20:52:01.708928322 (395h40m28.635223001s) [noise=true , address=104.36.82.44:4892 , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12RHwFxcUjPsn12uHEAH3fBDJKv1v1tM8mRJXoFrZrG5djdswF5, address:104.36.82.44:4892): protocol: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection
Jul 9 20:52:01.708993102 (395h40m28.635287793s) [seg_pos={0 0}, upload=316819]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 9 20:52:01.734227352 (395h40m28.66052204s) [upload=316819]: Done uploading segments...
Jul 9 20:52:01.734255282 (395h40m28.660549975s) [upload=316819]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 11.26762347s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.02751254s
FAIL (2025-07-09 20:52:01 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload=316819]: Done starting upload
Jul 9 20:51:01.744640664 (395h39m28.670935357s) [upload=316819]: Uploading segments...
Jul 9 20:51:01.745376443 (395h39m28.671671133s) [upload=316819]: Got next segment. Inline: false
Jul 9 20:51:01.745525760 (395h39m28.67182045s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 9 20:51:01.745533412 (395h39m28.671828085s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 9 20:51:01.783911087 (395h39m28.710205769s) [seg_pos={0 0}, upload=316819]: Begin upload segment...
Jul 9 20:51:01.783977239 (395h39m28.710271934s) [seg_pos={0 0}, upload=316819]: Done begin upload segment.
Jul 9 20:51:01.784009016 (395h39m28.710303716s) [noise=true , address=45.91.95.2:4009 , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.784481955 (395h39m28.710776649s) [noise=true , address=77.90.31.14:4678 , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.784908723 (395h39m28.711203414s) [noise=true , address=77.90.31.11:4578 , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.785241082 (395h39m28.711535772s) [noise=true , address=77.90.31.17:4784 , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.785533991 (395h39m28.711828684s) [noise=true , address=77.90.31.15:4709 , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.785835130 (395h39m28.71212983s) [noise=true , address=45.91.116.5:4315 , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.786163209 (395h39m28.712457905s) [noise=true , address=45.91.95.4:4001 , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.786710678 (395h39m28.713005376s) [noise=true , address=45.91.95.3:4033 , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.787413905 (395h39m28.713708604s) [noise=true , address=104.36.82.3:4782 , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.788027996 (395h39m28.714322693s) [noise=true , address=77.90.31.13:4632 , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.788820165 (395h39m28.715114861s) [noise=true , address=104.36.82.44:4892 , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.789282608 (395h39m28.715577305s) [noise=true , address=45.91.95.5:4012 , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.789720674 (395h39m28.716015375s) [noise=true , address=77.90.31.21:4880 , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.790132999 (395h39m28.716427699s) [noise=true , address=104.36.82.6:4906 , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.790759994 (395h39m28.71705469s) [noise=true , address=104.36.82.23:4464 , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.795058621 (395h39m28.721353314s) [noise=true , address=77.90.31.10:4523 , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.795650095 (395h39m28.721944823s) [noise=true , address=104.36.82.19:4403 , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.798606176 (395h39m28.724900871s) [noise=true , address=77.90.31.19:4860 , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul 9 20:51:01.909993379 (395h39m28.836288058s) [upload=316819]: Next returned nil segment
Jul 9 20:51:01.910016191 (395h39m28.83631089s) [upload=316819]: Waiting for error group managing segments...
Jul 9 20:51:01.919116414 (395h39m28.845411096s) [noise=true , address=77.90.31.14:4678 , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.919780312 (395h39m28.846074986s) [noise=true , address=77.90.31.11:4578 , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.920354582 (395h39m28.846649276s) [noise=true , address=77.90.31.21:4880 , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.921019660 (395h39m28.847314356s) [noise=true , address=77.90.31.17:4784 , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.922603097 (395h39m28.848897786s) [noise=true , address=77.90.31.13:4632 , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.932689000 (395h39m28.858983677s) [noise=true , address=77.90.31.19:4860 , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.934674660 (395h39m28.86096935s) [noise=true , address=77.90.31.15:4709 , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:01.936194700 (395h39m28.862489378s) [noise=true , address=77.90.31.10:4523 , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:02.795832904 (395h39m29.722127608s) [noise=true , address=45.91.95.2:4009 , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:1SrEo4XQ8dBq87CWMuQvExnt7TuL9JbwXqFSehpJ6pPsCHBAi6, address:45.91.95.2:4009): protocol: storage node overloaded, request limit: 2000
Jul 9 20:51:03.997629008 (395h39m30.923923684s) [noise=true , address=45.91.95.3:4033 , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12p7yU1B5SZNrV43Fd8jJr2FSykKDV1QsVgTCNgcBMtB46DazUD, address:45.91.95.3:4033): protocol: storage node overloaded, request limit: 2000
Jul 9 20:51:04.680596617 (395h39m31.606891297s) [noise=true , address=45.91.116.5:4315 , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:06.998485262 (395h39m33.924779955s) [noise=true , address=45.91.95.5:4012 , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:121sqZ4w3zPsKS2g6ufEhdqzBnZcws9558iAfpfrKxdEm6LhA5S, address:45.91.95.5:4012): protocol: storage node overloaded, request limit: 2000
Jul 9 20:51:22.922410916 (395h39m49.848705597s) [noise=true , address=104.36.82.23:4464 , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:29.420748222 (395h39m56.347042898s) [noise=true , address=45.91.95.4:4001 , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:31.417155305 (395h39m58.343450001s) [noise=true , address=104.36.82.6:4906 , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:51:42.331922832 (395h40m9.258217513s) [noise=true , address=104.36.82.3:4782 , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul 9 20:52:01.708814311 (395h40m28.635109007s) [noise=true , address=104.36.82.19:4403 , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:104.36.82.19:4403): protocol: expected piece hash; context deadline exceeded; EOF
Jul 9 20:52:01.708928322 (395h40m28.635223001s) [noise=true , address=104.36.82.44:4892 , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12RHwFxcUjPsn12uHEAH3fBDJKv1v1tM8mRJXoFrZrG5djdswF5, address:104.36.82.44:4892): protocol: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection
Jul 9 20:52:01.708993102 (395h40m28.635287793s) [seg_pos={0 0}, upload=316819]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 9 20:52:01.734227352 (395h40m28.66052204s) [upload=316819]: Done uploading segments...
Jul 9 20:52:01.734255282 (395h40m28.660549975s) [upload=316819]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.027537616s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...X.........X..............................................] duration:
36.32142563s
FAIL (2025-07-09 20:51:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 36.321447274s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.....X...................................] duration:
454.960102ms
FAIL (2025-07-09 20:51:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 454.985919ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....X.........X.............................................] duration:
20.636100389s
FAIL (2025-07-09 20:51:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.636130832s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.....X..................................] duration:
22.842550195s
FAIL (2025-07-09 20:50:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 22.842576971s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....X.........X............................................] duration:
51.404994417s
FAIL (2025-07-09 20:50:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 51.405016132s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [X...................X.....X.................................] duration:
1.493398432s
FAIL (2025-07-09 20:49:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.493487153s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......X.........X...........................................] duration:
24.029645401s
FAIL (2025-07-09 20:49:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.029669822s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X...................X.....X................................] duration:
688.573555ms
FAIL (2025-07-09 20:49:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 688.622383ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........X..........................................] duration:
44.740424528s
FAIL (2025-07-09 20:48:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 44.740448705s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X.....X...............................] duration:
617.500277ms
FAIL (2025-07-09 20:48:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 617.523948ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........X.........X.........................................] duration:
48.122346393s
FAIL (2025-07-09 20:47:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 48.122360256s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X.....X..............................] duration:
540.852645ms
FAIL (2025-07-09 20:47:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 541.272674ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [X........X.........X........................................] duration:
52.029032579s
FAIL (2025-07-09 20:47:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 52.02906831s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X.....X.............................] duration:
517.25717ms
FAIL (2025-07-09 20:46:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 517.285765ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.X........X.........X.......................................] duration:
22.380419532s
FAIL (2025-07-09 20:46:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 22.380442845s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X.....X............................] duration:
600.335095ms
FAIL (2025-07-09 20:45:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 600.397275ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..X........X.........X......................................] duration:
19.337303162s
FAIL (2025-07-09 20:45:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 19.337321754s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...X........X.........X.....................................] duration:
29.243723208s
FAIL (2025-07-09 20:45:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 29.243851508s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X.....X...........................] duration:
538.645331ms
FAIL (2025-07-09 20:45:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 538.684049ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [....X........X.........X....................................] duration:
40.062913289s
FAIL (2025-07-09 20:44:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 40.062929883s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.....X........X.........X...................................] duration:
26.286754876s
FAIL (2025-07-09 20:44:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 26.286791683s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X.....X..........................] duration:
583.69746ms
FAIL (2025-07-09 20:43:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 583.719231ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [......X........X.........X..................................] duration:
17.67059221s
FAIL (2025-07-09 20:43:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.670683096s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X.....X.........................] duration:
739.667999ms
FAIL (2025-07-09 20:42:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 739.69458ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X.....X........................] duration:
24.624799242s
FAIL (2025-07-09 20:42:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.624857008s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.......X........X.........X.................................] duration:
19.884016842s
FAIL (2025-07-09 20:42:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 19.884047825s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [........X........X.........X................................] duration:
17.357554912s
FAIL (2025-07-09 20:41:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.357603659s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X.....X.......................] duration:
6.268887074s
FAIL (2025-07-09 20:41:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.268907192s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.........X........X.........X...............................] duration:
40.200197842s
FAIL (2025-07-09 20:41:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 40.200501434s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..........X........X.........X..............................] duration:
27.408203152s
FAIL (2025-07-09 20:40:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 27.408229149s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X.....X......................] duration:
748.259783ms
FAIL (2025-07-09 20:40:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 748.294002ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...........X........X.........X.............................] duration:
56.751707857s
FAIL (2025-07-09 20:39:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 56.751750586s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...................X.....X.....................] duration:
561.998837ms
FAIL (2025-07-09 20:39:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 562.041168ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...................X.....X....................] duration:
537.099492ms
FAIL (2025-07-09 20:38:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 537.127179ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [............X........X.........X............................] duration:
34.52796926s
FAIL (2025-07-09 20:38:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 34.528043969s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...................X.....X...................] duration:
561.398687ms
FAIL (2025-07-09 20:38:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 561.472133ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.............X........X.........X...........................] duration:
25.676338843s
FAIL (2025-07-09 20:37:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 25.676365321s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..............X...................X.....X..................] duration:
491.534442ms
FAIL (2025-07-09 20:37:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 491.567906ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..............X........X.........X..........................] duration:
21.978170375s
FAIL (2025-07-09 20:36:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 21.978193706s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..............X...................X.....X.................] duration:
879.479253ms
FAIL (2025-07-09 20:36:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 879.507501ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..............X...................X.....X................] duration:
631.566669ms
FAIL (2025-07-09 20:36:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 631.611178ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...............X........X.........X.........................] duration:
7.604470901s
FAIL (2025-07-09 20:35:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.604491205s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..............X...................X.....X...............] duration:
491.389632ms
FAIL (2025-07-09 20:35:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 491.41284ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [................X........X.........X........................] duration:
28.065928389s
FAIL (2025-07-09 20:35:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 28.065960023s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.................X........X.........X.......................] duration:
50.13385408s
FAIL (2025-07-09 20:34:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 50.133877023s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..............X...................X.....X..............] duration:
8.350678386s
FAIL (2025-07-09 20:34:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.350742299s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..................X........X.........X......................] duration:
24.155033896s
FAIL (2025-07-09 20:33:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.155063521s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..............X...................X.....X.............] duration:
634.397416ms
FAIL (2025-07-09 20:33:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 634.442042ms
edge
gateway
us-select-1
|