Orbiter History

Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 164794 reports (Page 3115 of 3296)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................................................XXXX.] duration: 505.104127ms FAIL (2025-07-08 05:02:05 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 505.135984ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................................................XXX.] duration: 701.340734ms FAIL (2025-07-08 05:01:38 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 701.373556ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.045247686s FAIL (2025-07-08 05:01:37 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 1m0.04526798s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 30.038349156s FAIL (2025-07-08 05:01:23 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 30.038373369s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.030315763s FAIL (2025-07-08 05:00:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== e_id=WOZIMVHYWFVQ6QLMDHKZX7VQJL6B6PRSJ2DAIDK4D662JS4VR52A, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.010206005 (355h48m3.936500715s) [noise=true , address=77.90.31.12:4597 , piece_id=T5D5F2L7YLLF7RPRRQ5P7G4X6SGGY247FZHRZHD36VWUFNDKYFYQ, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.010460939 (355h48m3.936755634s) [noise=true , address=77.90.31.16:4768 , piece_id=H7RIACMA2JSW6SRJXGAYTPW6O2YVR5B3ITGF22NERBLCPZXTWK7A, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.010720398 (355h48m3.937015094s) [noise=true , address=104.36.82.23:4463 , piece_id=RVJCM44DUIHDVW7CEVWXKLAGR5PCV4FQ3RTJJCYIRFIBUJJ2337Q, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.010752907 (355h48m3.937047596s) [noise=true , address=77.90.31.17:4800 , piece_id=M245ZTB763P7IZDZXHRJYTCZ6WQML4YTF54ZJHM3GD4THUPRHWNQ, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.011099254 (355h48m3.93739395s) [noise=true , address=104.36.82.3:4796 , piece_id=P675BBI6AJJ3FKBUIUGRTMW2IGEGVMEIXVGNLL6GPXJAM65IESOA, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.011345170 (355h48m3.937639866s) [noise=true , address=104.36.82.17:4350 , piece_id=RMPENKGKW76WJLAJ6O6CLCNVCYUHF3Z5OUXRLWRL2OCDJ3QWEVIQ, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.011479132 (355h48m3.937773825s) [noise=true , address=104.36.82.38:4694 , piece_id=6NNYNFVAYB7PZ6GS4I4F474UO4ZQY6LQN6IXGGNAYAC5EY3ZJWDQ, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.011759839 (355h48m3.938054526s) [noise=true , address=79.127.205.233:4653 , piece_id=RX54MPX6EQZLJXU27QA2LGY2YYA5TAZEKWWLIR2JMF72O74PF74Q, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.012029107 (355h48m3.938323804s) [noise=true , address=77.90.31.10:4535 , piece_id=HN32GCJV3PZ3M3FDSVMPCGZHK32PQ7ZXHZOYGMSGDHTMTOMAPRCA, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.012058935 (355h48m3.938353634s) [noise=true , address=77.90.31.18:4819 , piece_id=TTOEDZPVWWU3CI5MNSS6PWPTFUYNEEMQCGZCCXH23OQZRJ355REA, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.012360027 (355h48m3.938654716s) [noise=true , address=104.36.82.60:4370 , piece_id=YC3ZUTPPWXX4CNL3RZAUIRMWF4Q5IS7QRXFLAQSAKIJ2PKWCMIMQ, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.012531586 (355h48m3.938826282s) [noise=true , address=104.36.82.16:4314 , piece_id=EVKEMJAOT6BYGJ5M72OOKLREZFDCGLQV2O77V4MA3DDARSQPVP5Q, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.013016850 (355h48m3.939311547s) [noise=true , address=77.90.31.21:4887 , piece_id=BNABDW7QBTGYSFUGU4D75TFYBH7T3QYAHVTPTVMUSNL5MPYNWJWA, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.014609866 (355h48m3.940904538s) [noise=true , address=104.36.82.5:4867 , piece_id=ODWTDAEZ2ZKE24TOUDUCMDW3ZIHVBCH22GXPMF2QIW26WMIKOPSQ, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.015937639 (355h48m3.942232315s) [noise=true , address=45.91.116.12:4238 , piece_id=P5OESSGVOJMOZUWDVN4VF7NPP2E6Q3XRIRFC6H2IRNSVCANSOMWA, seg_pos={0 0}, upload=284976]: Uploading piece... Jul 8 04:59:37.094391130 (355h48m4.020685808s) [upload=284976]: Next returned nil segment Jul 8 04:59:37.094406523 (355h48m4.020701211s) [upload=284976]: Waiting for error group managing segments... Jul 8 04:59:37.104183185 (355h48m4.030477857s) [noise=true , address=104.36.82.3:4796 , piece_id=P675BBI6AJJ3FKBUIUGRTMW2IGEGVMEIXVGNLL6GPXJAM65IESOA, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.107247920 (355h48m4.033542596s) [noise=true , address=104.36.82.38:4694 , piece_id=6NNYNFVAYB7PZ6GS4I4F474UO4ZQY6LQN6IXGGNAYAC5EY3ZJWDQ, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.107485837 (355h48m4.033780527s) [noise=true , address=104.36.82.5:4867 , piece_id=ODWTDAEZ2ZKE24TOUDUCMDW3ZIHVBCH22GXPMF2QIW26WMIKOPSQ, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.114508542 (355h48m4.040803225s) [noise=true , address=104.36.82.16:4314 , piece_id=EVKEMJAOT6BYGJ5M72OOKLREZFDCGLQV2O77V4MA3DDARSQPVP5Q, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.118786063 (355h48m4.04508075s) [noise=true , address=104.36.82.17:4350 , piece_id=RMPENKGKW76WJLAJ6O6CLCNVCYUHF3Z5OUXRLWRL2OCDJ3QWEVIQ, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.119230968 (355h48m4.045525648s) [noise=true , address=104.36.82.60:4370 , piece_id=YC3ZUTPPWXX4CNL3RZAUIRMWF4Q5IS7QRXFLAQSAKIJ2PKWCMIMQ, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.120873761 (355h48m4.047168452s) [noise=true , address=104.36.82.23:4463 , piece_id=RVJCM44DUIHDVW7CEVWXKLAGR5PCV4FQ3RTJJCYIRFIBUJJ2337Q, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 04:59:37.618509124 (355h48m4.544803801s) [noise=true , address=79.127.205.233:4653 , piece_id=RX54MPX6EQZLJXU27QA2LGY2YYA5TAZEKWWLIR2JMF72O74PF74Q, seg_pos={0 0}, upload=284976]: Done uploading piece. err: <nil> Jul 8 05:00:36.941587086 (355h49m3.867881784s) [noise=true , address=45.91.116.12:4238 , piece_id=P5OESSGVOJMOZUWDVN4VF7NPP2E6Q3XRIRFC6H2IRNSVCANSOMWA, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: rpc: dial tcp 45.91.116.12:4238: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.941725779 (355h49m3.868020475s) [noise=true , address=77.90.31.17:4800 , piece_id=M245ZTB763P7IZDZXHRJYTCZ6WQML4YTF54ZJHM3GD4THUPRHWNQ, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt, address:77.90.31.17:4800): protocol: write tcp 159.223.143.39:43900->77.90.31.17:4800: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.941804338 (355h49m3.868099028s) [noise=true , address=77.90.31.19:4856 , piece_id=MTHUPTDIK643SD6FN3I2FQTGH647YINQYNUWJJHMP6CDHYPDTIYA, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.941901656 (355h49m3.868196344s) [noise=true , address=77.90.31.21:4887 , piece_id=BNABDW7QBTGYSFUGU4D75TFYBH7T3QYAHVTPTVMUSNL5MPYNWJWA, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ, address:77.90.31.21:4887): protocol: rpc: dial tcp 77.90.31.21:4887: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.941952534 (355h49m3.868247227s) [noise=true , address=77.90.31.15:4715 , piece_id=WOZIMVHYWFVQ6QLMDHKZX7VQJL6B6PRSJ2DAIDK4D662JS4VR52A, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:12WXsguvsox5t3gJTmYgXxSvS9Wha4DSSzhfadhoASU4see1FCs, address:77.90.31.15:4715): protocol: rpc: dial tcp 77.90.31.15:4715: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.941975035 (355h49m3.868269728s) [noise=true , address=77.90.31.10:4535 , piece_id=HN32GCJV3PZ3M3FDSVMPCGZHK32PQ7ZXHZOYGMSGDHTMTOMAPRCA, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz, address:77.90.31.10:4535): protocol: rpc: dial tcp 77.90.31.10:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.942023788 (355h49m3.868318475s) [noise=true , address=77.90.31.16:4768 , piece_id=H7RIACMA2JSW6SRJXGAYTPW6O2YVR5B3ITGF22NERBLCPZXTWK7A, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:12UchewmtxBrtSZSpVAJFdZmcTsQVQxkjK9re6cgUGqDhyonQeF, address:77.90.31.16:4768): protocol: rpc: dial tcp 77.90.31.16:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.942054379 (355h49m3.868349077s) [noise=true , address=77.90.31.12:4597 , piece_id=T5D5F2L7YLLF7RPRRQ5P7G4X6SGGY247FZHRZHD36VWUFNDKYFYQ, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:127QMaS39fDFZixRP6gVMQkZMefSxLo3ToPctZuDmaARY6nB3H9, address:77.90.31.12:4597): protocol: rpc: dial tcp 77.90.31.12:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.942084666 (355h49m3.868379353s) [noise=true , address=77.90.31.18:4819 , piece_id=TTOEDZPVWWU3CI5MNSS6PWPTFUYNEEMQCGZCCXH23OQZRJ355REA, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:12nKVfrEuBKwyvtfYLJyfJ1Fo5gVVJU2Z6DNNvDEK8sKTmCW1Da, address:77.90.31.18:4819): protocol: rpc: dial tcp 77.90.31.18:4819: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.942096888 (355h49m3.868391577s) [noise=true , address=77.90.31.10:4551 , piece_id=JVSUZXHP36AMZWHGDP3DC5JK2BLYH5IDC5VJVDXX3EZRGP45SW2Q, seg_pos={0 0}, upload=284976]: Done uploading piece. err: ecclient: upload failed (node:1EWyjRCErG9odC8xXPFaLXNWfsega2SLNbKHjbawahraGqDCwr, address:77.90.31.10:4551): protocol: rpc: dial tcp 77.90.31.10:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:36.942139142 (355h49m3.868433837s) [seg_pos={0 0}, upload=284976]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:00:36.969964930 (355h49m3.896259608s) [upload=284976]: Done uploading segments... Jul 8 05:00:36.969990194 (355h49m3.896284883s) [upload=284976]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 1m0.030355786s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.033001487s FAIL (2025-07-08 05:00:11 UTC) ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== seg_pos={0 0}, upload=284978]: Begin upload segment... Jul 8 04:59:41.868920906 (355h48m8.795215598s) [seg_pos={0 0}, upload=284978]: Done begin upload segment. Jul 8 04:59:41.868955986 (355h48m8.795250682s) [noise=true , address=104.36.82.11:4113 , piece_id=4RSACDYQFDCYVAK3EF65AQTOJIJPL5SADVLP5FCADBD4P2ZCXBQA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.869691070 (355h48m8.795985766s) [noise=true , address=104.36.82.15:4257 , piece_id=XNHTJKWSPVYQF7ZNWM3TN3SC5TKPGGHVWHOILZMK3BWUYNGOVZRA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.870392028 (355h48m8.796686724s) [noise=true , address=45.91.116.9:4262 , piece_id=FQGT4R6I3NFZWOEHQMZMRIJXB7YOQ533RYJIPNOS52B5MVP5LHJA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.870480322 (355h48m8.796775019s) [noise=true , address=77.90.31.12:4590 , piece_id=7WW4QM43I3WQRO4YBDE4N4GTIS6TVC75KAFTAVXEH2JQSFO5ZW6Q, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.871788982 (355h48m8.798083681s) [noise=true , address=104.36.82.9:4005 , piece_id=DT42SUO75O2ZNZFR6PDQVFV3JYK3MDNRQOMLMJ3AITC3CZK23TFA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.871891772 (355h48m8.798186469s) [noise=true , address=104.36.82.4:4804 , piece_id=5LQ6SU6ART3KWLAW57YROMOLHPRTI4CJDGQSZDYHFAGMQTYC6PZQ, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.872883289 (355h48m8.799177986s) [noise=true , address=77.90.31.17:4772 , piece_id=4KJIZFONQI2ZW6E4LCJLK7AV6YNXNO6TLTIYRX6RTY2PSMJTSWGQ, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.873152526 (355h48m8.799447223s) [noise=true , address=104.36.82.13:4186 , piece_id=4JV7VMYPXDIYXDYZWFFEGPMMDO4OVFAJ6QQPGALJGHFXOVJNDSBA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.874776741 (355h48m8.801071439s) [noise=true , address=77.90.31.11:4554 , piece_id=IFZ6BSYAKPJESPHRYBOTMRG2SH2SI6FJIXZTW7VXTVKMDMTE7UGA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.876255714 (355h48m8.802550411s) [noise=true , address=45.91.116.7:4011 , piece_id=M5JXW4CZ5YYH5QQ6ZI7UI3BOVF454XTRVPGC7BR4KVDZYPNWVWMA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.877038167 (355h48m8.803332864s) [noise=true , address=45.91.116.11:4119 , piece_id=KOGOTYHDI5K257OAIS4U7LEI73ALZG67UYXV6G4LESOBV5DUOS3Q, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.877760963 (355h48m8.804055661s) [noise=true , address=77.90.31.21:4877 , piece_id=AU7ZCN66TOZG7OHMVZKHIY5LYSQWEH4JOEYTH7DBDONTN3JIYQEA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.880215388 (355h48m8.806510087s) [noise=true , address=77.90.31.19:4841 , piece_id=XJTYU6Z4VZD4762UH6ZUPTJ2ITEYDNAY4D3U43X2PM2PCTCK56FA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.882582167 (355h48m8.808876864s) [noise=true , address=45.91.116.7:4010 , piece_id=PCULXJJUO5ZX7HBXM3QUCECJDN2YDD3ZSUH43ZUNPKP64ZCPPEHQ, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.885598579 (355h48m8.811893277s) [noise=true , address=77.90.31.16:4733 , piece_id=FTNAXXKQC5M5XDFBH7YCXKW2EUUPMAZKKOWS6S6HL4QWAKTL5TTQ, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.888744721 (355h48m8.815039417s) [noise=true , address=45.91.116.11:4117 , piece_id=PXDFYNFSXZIJD3ZCSEUP4FSPLQF24I7VAB3OTD5FCIW5C6CPLFVA, seg_pos={0 0}, upload=284978]: Uploading piece... Jul 8 04:59:41.965700295 (355h48m8.891994991s) [upload=284978]: Next returned nil segment Jul 8 04:59:41.965718674 (355h48m8.892013372s) [upload=284978]: Waiting for error group managing segments... Jul 8 04:59:41.974502255 (355h48m8.900796946s) [noise=true , address=104.36.82.9:4005 , piece_id=DT42SUO75O2ZNZFR6PDQVFV3JYK3MDNRQOMLMJ3AITC3CZK23TFA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: <nil> Jul 8 04:59:41.974748539 (355h48m8.901043227s) [noise=true , address=104.36.82.4:4804 , piece_id=5LQ6SU6ART3KWLAW57YROMOLHPRTI4CJDGQSZDYHFAGMQTYC6PZQ, seg_pos={0 0}, upload=284978]: Done uploading piece. err: <nil> Jul 8 04:59:41.975128013 (355h48m8.901422706s) [noise=true , address=104.36.82.11:4113 , piece_id=4RSACDYQFDCYVAK3EF65AQTOJIJPL5SADVLP5FCADBD4P2ZCXBQA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: <nil> Jul 8 04:59:41.975551025 (355h48m8.901845703s) [noise=true , address=104.36.82.13:4186 , piece_id=4JV7VMYPXDIYXDYZWFFEGPMMDO4OVFAJ6QQPGALJGHFXOVJNDSBA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: <nil> Jul 8 04:59:41.975822956 (355h48m8.902117632s) [noise=true , address=104.36.82.15:4257 , piece_id=XNHTJKWSPVYQF7ZNWM3TN3SC5TKPGGHVWHOILZMK3BWUYNGOVZRA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: <nil> Jul 8 05:00:11.809112173 (355h48m38.735406856s) [noise=true , address=45.91.116.11:4119 , piece_id=KOGOTYHDI5K257OAIS4U7LEI73ALZG67UYXV6G4LESOBV5DUOS3Q, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809218420 (355h48m38.735513109s) [noise=true , address=77.90.31.12:4590 , piece_id=7WW4QM43I3WQRO4YBDE4N4GTIS6TVC75KAFTAVXEH2JQSFO5ZW6Q, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 159.223.143.39:48472->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809274243 (355h48m38.735568919s) [noise=true , address=77.90.31.19:4841 , piece_id=XJTYU6Z4VZD4762UH6ZUPTJ2ITEYDNAY4D3U43X2PM2PCTCK56FA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809381528 (355h48m38.735676208s) [noise=true , address=77.90.31.17:4772 , piece_id=4KJIZFONQI2ZW6E4LCJLK7AV6YNXNO6TLTIYRX6RTY2PSMJTSWGQ, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809459856 (355h48m38.735754537s) [noise=true , address=77.90.31.16:4733 , piece_id=FTNAXXKQC5M5XDFBH7YCXKW2EUUPMAZKKOWS6S6HL4QWAKTL5TTQ, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809478454 (355h48m38.73577313s) [noise=true , address=45.91.116.7:4010 , piece_id=PCULXJJUO5ZX7HBXM3QUCECJDN2YDD3ZSUH43ZUNPKP64ZCPPEHQ, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809489558 (355h48m38.735784237s) [noise=true , address=45.91.116.9:4262 , piece_id=FQGT4R6I3NFZWOEHQMZMRIJXB7YOQ533RYJIPNOS52B5MVP5LHJA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; context deadline exceeded Jul 8 05:00:11.809506439 (355h48m38.735801121s) [noise=true , address=77.90.31.11:4554 , piece_id=IFZ6BSYAKPJESPHRYBOTMRG2SH2SI6FJIXZTW7VXTVKMDMTE7UGA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809530555 (355h48m38.735825232s) [noise=true , address=77.90.31.21:4877 , piece_id=AU7ZCN66TOZG7OHMVZKHIY5LYSQWEH4JOEYTH7DBDONTN3JIYQEA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809567810 (355h48m38.735862488s) [noise=true , address=45.91.116.7:4011 , piece_id=M5JXW4CZ5YYH5QQ6ZI7UI3BOVF454XTRVPGC7BR4KVDZYPNWVWMA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 159.223.143.39:38076->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:00:11.809764561 (355h48m38.736059254s) [noise=true , address=45.91.116.11:4117 , piece_id=PXDFYNFSXZIJD3ZCSEUP4FSPLQF24I7VAB3OTD5FCIW5C6CPLFVA, seg_pos={0 0}, upload=284978]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: context deadline exceeded; context deadline exceeded Jul 8 05:00:11.809803994 (355h48m38.736098697s) [seg_pos={0 0}, upload=284978]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:00:11.838763376 (355h48m38.765058054s) [upload=284978]: Done uploading segments... Jul 8 05:00:11.838801272 (355h48m38.765095976s) [upload=284978]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 30.033027051s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.036867655s FAIL (2025-07-08 04:59:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 2) ======LOGS====== SCGQLKHITOQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.757414964 (355h47m38.683709662s) [noise=true , address=45.91.116.8:4045 , piece_id=A52AQRFDXBST3DQE64EIIX4E7YXBYISBCLPZ2RYND7LCHF5XA66A, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.758146967 (355h47m38.684441662s) [noise=true , address=45.91.116.7:4010 , piece_id=7LSYMSUWWHRZTD6DUXAVRO6YIBNNTRJ5HYGXUBP7GKZQEFQ3GYPQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.758675084 (355h47m38.684969781s) [noise=true , address=45.91.116.5:4299 , piece_id=TRR24BMDXSF3TC4LIJTYKA5CTPCPB6JI7IGFV6YVLR6HTPLCZQAQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.759230488 (355h47m38.685525164s) [noise=true , address=45.91.116.4:4939 , piece_id=454KSMBG7TM6XURJOYU2RB2XY7J2NFZ2ZIQPM4Z6JWDFUVPTXEMQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.759883603 (355h47m38.686178295s) [noise=true , address=77.90.31.18:4806 , piece_id=VPJRCA3GTMVVZVU72I2HDZU3L5STLW2HQX5WOBDOITQXIFCEOYTA, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.760465430 (355h47m38.686760103s) [noise=true , address=104.36.82.8:4969 , piece_id=UIMHZLUX7BLNJA7SKNJY5KKLCRQC2TT3XBXKSUCUGPYZIUBVRIXQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.761056831 (355h47m38.687351526s) [noise=true , address=104.36.82.12:4149 , piece_id=OSJT53GPZ3PMZ3MLNAMXH22FO7YGLZMDXPCMUARR4LVJ5J2TUKFQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.761615684 (355h47m38.687910374s) [noise=true , address=77.90.31.10:4519 , piece_id=KMUGIUA6HZBVTGZ5MTWVWGWHRRRZFXEIB7N4WPKKSIBYBAJABUGQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.762144161 (355h47m38.68843885s) [noise=true , address=45.91.116.11:4119 , piece_id=PUS4NQWROJ6E3HNILGGV5TDHBGJ5PKH5O7AJP7ZNEGUNRSJD7XYQ, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.762784658 (355h47m38.689079354s) [noise=true , address=77.90.31.14:4662 , piece_id=KWSJ4TE3PWDEIRQNWV4RLKWBG4DP5WZOFA3IJV5BGZRSCXCYAD3Q, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.763407486 (355h47m38.689702183s) [noise=true , address=77.90.31.21:4877 , piece_id=OS72YZ6JKGKWQYJOFFT6HMDRGHYY6ROP3L5PWIXYLRLAO52KBLTA, seg_pos={0 0}, upload=284971]: Uploading piece... Jul 8 04:59:11.851538946 (355h47m38.777833624s) [upload=284971]: Next returned nil segment Jul 8 04:59:11.851591856 (355h47m38.777886553s) [upload=284971]: Waiting for error group managing segments... Jul 8 04:59:11.861206824 (355h47m38.787501501s) [noise=true , address=104.36.82.12:4149 , piece_id=OSJT53GPZ3PMZ3MLNAMXH22FO7YGLZMDXPCMUARR4LVJ5J2TUKFQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: <nil> Jul 8 04:59:11.862498540 (355h47m38.788793214s) [noise=true , address=104.36.82.8:4969 , piece_id=UIMHZLUX7BLNJA7SKNJY5KKLCRQC2TT3XBXKSUCUGPYZIUBVRIXQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: <nil> Jul 8 04:59:41.691257118 (355h48m8.617551816s) [noise=true , address=77.90.31.15:4697 , piece_id=6LKGTRL6KSVLMMFGLLT5XEHXUCCDRX6XHXP6V2VULJWQTQ6FGQDA, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 159.223.143.39:41584->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691496365 (355h48m8.617791055s) [noise=true , address=45.91.116.5:4299 , piece_id=TRR24BMDXSF3TC4LIJTYKA5CTPCPB6JI7IGFV6YVLR6HTPLCZQAQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 159.223.143.39:41724->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691606352 (355h48m8.61790104s) [noise=true , address=77.90.31.10:4519 , piece_id=KMUGIUA6HZBVTGZ5MTWVWGWHRRRZFXEIB7N4WPKKSIBYBAJABUGQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 159.223.143.39:57934->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691701011 (355h48m8.617995698s) [noise=true , address=77.90.31.14:4662 , piece_id=KWSJ4TE3PWDEIRQNWV4RLKWBG4DP5WZOFA3IJV5BGZRSCXCYAD3Q, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 159.223.143.39:60886->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691711622 (355h48m8.618006316s) [noise=true , address=77.90.31.21:4877 , piece_id=OS72YZ6JKGKWQYJOFFT6HMDRGHYY6ROP3L5PWIXYLRLAO52KBLTA, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 159.223.143.39:52828->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691775301 (355h48m8.61806999s) [noise=true , address=45.91.116.11:4119 , piece_id=PUS4NQWROJ6E3HNILGGV5TDHBGJ5PKH5O7AJP7ZNEGUNRSJD7XYQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:52232->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691806647 (355h48m8.61810134s) [noise=true , address=45.91.116.8:4045 , piece_id=A52AQRFDXBST3DQE64EIIX4E7YXBYISBCLPZ2RYND7LCHF5XA66A, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 159.223.143.39:41992->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691890346 (355h48m8.618185034s) [noise=true , address=45.91.116.4:4939 , piece_id=454KSMBG7TM6XURJOYU2RB2XY7J2NFZ2ZIQPM4Z6JWDFUVPTXEMQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 159.223.143.39:43364->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.691898335 (355h48m8.618193024s) [noise=true , address=45.91.116.7:4010 , piece_id=7LSYMSUWWHRZTD6DUXAVRO6YIBNNTRJ5HYGXUBP7GKZQEFQ3GYPQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: context deadline exceeded; context deadline exceeded Jul 8 04:59:41.691958773 (355h48m8.618253464s) [noise=true , address=77.90.31.18:4806 , piece_id=VPJRCA3GTMVVZVU72I2HDZU3L5STLW2HQX5WOBDOITQXIFCEOYTA, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 159.223.143.39:58772->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.692000946 (355h48m8.618295634s) [noise=true , address=77.90.31.19:4841 , piece_id=FDGQGYTVOCPQXEV3DIQIENF4YMTFKFHCP2CDSYX42VTH6Y3KGONQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 159.223.143.39:59776->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.692030124 (355h48m8.618324817s) [noise=true , address=45.91.116.13:4153 , piece_id=4YPOW6YKIUXEDI5TQ7AN4ZDAVPF44SPOXCD2KY2NFLUWQ4KXOVKA, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 159.223.143.39:40254->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.692097697 (355h48m8.618392386s) [noise=true , address=77.90.31.16:4734 , piece_id=D5O7HNBQGIGCL77SFDUZ3KAFVXKNEI7BU564KM7FUSCGQLKHITOQ, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:54598->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.692106330 (355h48m8.618401019s) [noise=true , address=77.90.31.14:4663 , piece_id=UI2FPFBBKH2V32A3W2BKZJB7OTM3GIZZJXNWNKACWENBQ7SXEE3A, seg_pos={0 0}, upload=284971]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 159.223.143.39:34644->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:41.692142567 (355h48m8.618437262s) [seg_pos={0 0}, upload=284971]: Done waiting for segment. successful: 2 optimal: 13 errs: <nil> Jul 8 04:59:41.725797085 (355h48m8.652091765s) [upload=284971]: Done uploading segments... Jul 8 04:59:41.725824752 (355h48m8.652119429s) [upload=284971]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 2) Duration: 30.036888002s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.026043761s FAIL (2025-07-08 04:59:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 46m50.85222778s) [seg_pos={0 0}, upload=284963]: Done begin upload segment. Jul 8 04:58:23.925955463 (355h46m50.852250158s) [noise=true , address=77.90.31.17:4778 , piece_id=BMIBYNRW3KENPQD6N7LUGUW6MKEKASSHBSFLMSCNPTSUAIPGAZEQ, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.925981797 (355h46m50.852276493s) [noise=true , address=77.90.31.12:4597 , piece_id=HRQ7ZWXBMMV4AJ7UU6VKQ2R73UJS5XUBA56VVKD56E2KIHLKSL5Q, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.926041057 (355h46m50.852335737s) [noise=true , address=77.90.31.21:4912 , piece_id=ZH56N6WI32P76YZ5GDXWWIVI4X2Y6WPXGHBRBNU3SKEOCXMBS2QA, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.926378185 (355h46m50.852672878s) [noise=true , address=64.49.13.139:4469 , piece_id=HIMDSUD7QNK3RJHJ2YLXJTNGGCDOQYNYB3R774AGJ5TL4ZJFLAJA, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.926455832 (355h46m50.852750529s) [noise=true , address=77.90.31.19:4876 , piece_id=EKHESJSUSS37DD4OFWW77WDZB6FFTFHWRRBNUTQ2Z3JYEBHRO3BQ, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.926708846 (355h46m50.853003558s) [noise=true , address=104.36.82.40:4967 , piece_id=VDMSX3TMAY2BJ5IKQQHWM2K72VAVHOT27XGEEWQRDXKLSYXFX56Q, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.926875783 (355h46m50.853170463s) [noise=true , address=104.36.82.60:4355 , piece_id=T7YKRYQCK3IPMKKCY4QA64BLZ6EMJDR25KS3OAHP7T4ZKCS3WP2Q, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.927096616 (355h46m50.853391304s) [noise=true , address=104.36.82.18:4390 , piece_id=KFGXGJM5TV2BMQ33OCA2YH7L7EY6SBGLNJYTITZA2KEYQ4HSPQNQ, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.927478346 (355h46m50.853773034s) [noise=true , address=104.36.82.20:4445 , piece_id=FMVOXDGQSDYJCLA2OOCERGBJ4ELQYRHMSEAQXNT5VYSY5EVUHQ2Q, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.928967789 (355h46m50.855262481s) [noise=true , address=79.127.201.214:4301 , piece_id=RU7RHEMWA52GIDXFYSXFB2P7D5MUOEP67XTTVUBM6QRYZIXRBPDA, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.929313336 (355h46m50.855608024s) [noise=true , address=104.36.82.5:4863 , piece_id=UQTAOHY2I7ZIRJX5UTB7Q5ZEMHMAV3IZEH6DI4C25STZQRCNWV4Q, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.930705749 (355h46m50.857000437s) [noise=true , address=104.36.82.8:4975 , piece_id=YBVLLJB3WBWYA7XQ5HCX77TWIPGWCGWQLV45RGBT5NGC4YD7OK4A, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.931083567 (355h46m50.857378253s) [noise=true , address=104.36.82.13:4192 , piece_id=NYEYSJXK5PUKRQLCIATY3AZRAK5X37W5QRYVYVB4G25RJ32C4RZA, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.932403605 (355h46m50.858698294s) [noise=true , address=77.90.31.11:4564 , piece_id=UUOVDOGFB2L7ECIJRPQDYHSAVHBH5YP5FOWZTBIZYZ6DKYBN5BTA, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.932798156 (355h46m50.859092845s) [noise=true , address=104.36.82.23:4457 , piece_id=FENNYDNF2ODLWJSJ2UTFEENIXNVRZR3V7YNQQ7EPS4GIEQ2MTGRQ, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.933140270 (355h46m50.859434969s) [noise=true , address=79.127.201.215:4349 , piece_id=3R4PWXL7WU2QCKLSVA5MT5R5YAH4SMN6HEFASKOZP3IC6YIUU72A, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.933479834 (355h46m50.85977453s) [noise=true , address=77.90.31.10:4533 , piece_id=2LLUWKNXQRH36SVXYML2FSKZXIZJL2R7L4EUOE6Q5FFPDCB56G2A, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:23.933809412 (355h46m50.860104099s) [noise=true , address=77.90.31.15:4727 , piece_id=M5DI2U54226YBZCA5X75VU54BZGSZEI64FKRBHVVUB3ZFYHIB72Q, seg_pos={0 0}, upload=284963]: Uploading piece... Jul 8 04:58:24.016739404 (355h46m50.943034091s) [upload=284963]: Next returned nil segment Jul 8 04:58:24.016782435 (355h46m50.943077136s) [upload=284963]: Waiting for error group managing segments... Jul 8 04:58:24.024726483 (355h46m50.951021155s) [noise=true , address=104.36.82.13:4192 , piece_id=NYEYSJXK5PUKRQLCIATY3AZRAK5X37W5QRYVYVB4G25RJ32C4RZA, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.025300870 (355h46m50.951595551s) [noise=true , address=104.36.82.23:4457 , piece_id=FENNYDNF2ODLWJSJ2UTFEENIXNVRZR3V7YNQQ7EPS4GIEQ2MTGRQ, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.025547773 (355h46m50.951842446s) [noise=true , address=104.36.82.60:4355 , piece_id=T7YKRYQCK3IPMKKCY4QA64BLZ6EMJDR25KS3OAHP7T4ZKCS3WP2Q, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.026247654 (355h46m50.952542332s) [noise=true , address=104.36.82.5:4863 , piece_id=UQTAOHY2I7ZIRJX5UTB7Q5ZEMHMAV3IZEH6DI4C25STZQRCNWV4Q, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.026722978 (355h46m50.953017654s) [noise=true , address=104.36.82.20:4445 , piece_id=FMVOXDGQSDYJCLA2OOCERGBJ4ELQYRHMSEAQXNT5VYSY5EVUHQ2Q, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.027671674 (355h46m50.95396635s) [noise=true , address=104.36.82.18:4390 , piece_id=KFGXGJM5TV2BMQ33OCA2YH7L7EY6SBGLNJYTITZA2KEYQ4HSPQNQ, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.042620390 (355h46m50.968915084s) [noise=true , address=104.36.82.8:4975 , piece_id=YBVLLJB3WBWYA7XQ5HCX77TWIPGWCGWQLV45RGBT5NGC4YD7OK4A, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.051792375 (355h46m50.978087047s) [noise=true , address=104.36.82.40:4967 , piece_id=VDMSX3TMAY2BJ5IKQQHWM2K72VAVHOT27XGEEWQRDXKLSYXFX56Q, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.220471942 (355h46m51.146766618s) [noise=true , address=79.127.201.215:4349 , piece_id=3R4PWXL7WU2QCKLSVA5MT5R5YAH4SMN6HEFASKOZP3IC6YIUU72A, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.223706396 (355h46m51.150001073s) [noise=true , address=79.127.201.214:4301 , piece_id=RU7RHEMWA52GIDXFYSXFB2P7D5MUOEP67XTTVUBM6QRYZIXRBPDA, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:58:24.593862847 (355h46m51.520157537s) [noise=true , address=64.49.13.139:4469 , piece_id=HIMDSUD7QNK3RJHJ2YLXJTNGGCDOQYNYB3R774AGJ5TL4ZJFLAJA, seg_pos={0 0}, upload=284963]: Done uploading piece. err: <nil> Jul 8 04:59:23.856316877 (355h47m50.782611564s) [noise=true , address=77.90.31.21:4912 , piece_id=ZH56N6WI32P76YZ5GDXWWIVI4X2Y6WPXGHBRBNU3SKEOCXMBS2QA, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1, address:77.90.31.21:4912): protocol: write tcp 159.223.143.39:35990->77.90.31.21:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856719887 (355h47m50.783014577s) [noise=true , address=77.90.31.19:4876 , piece_id=EKHESJSUSS37DD4OFWW77WDZB6FFTFHWRRBNUTQ2Z3JYEBHRO3BQ, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB, address:77.90.31.19:4876): protocol: write tcp 159.223.143.39:51490->77.90.31.19:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856793992 (355h47m50.783088678s) [noise=true , address=77.90.31.15:4727 , piece_id=M5DI2U54226YBZCA5X75VU54BZGSZEI64FKRBHVVUB3ZFYHIB72Q, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: rpc: dial tcp 77.90.31.15:4727: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856818179 (355h47m50.783112877s) [noise=true , address=77.90.31.17:4778 , piece_id=BMIBYNRW3KENPQD6N7LUGUW6MKEKASSHBSFLMSCNPTSUAIPGAZEQ, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:12icjsyKdwPqDddPbEZpCJvX1pxmTLSy8ZfFUMCJU1SxPsKGdZo, address:77.90.31.17:4778): protocol: rpc: dial tcp 77.90.31.17:4778: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856864739 (355h47m50.783159412s) [noise=true , address=77.90.31.11:4564 , piece_id=UUOVDOGFB2L7ECIJRPQDYHSAVHBH5YP5FOWZTBIZYZ6DKYBN5BTA, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: rpc: dial tcp 77.90.31.11:4564: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856892267 (355h47m50.783186957s) [noise=true , address=77.90.31.12:4597 , piece_id=HRQ7ZWXBMMV4AJ7UU6VKQ2R73UJS5XUBA56VVKD56E2KIHLKSL5Q, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:127QMaS39fDFZixRP6gVMQkZMefSxLo3ToPctZuDmaARY6nB3H9, address:77.90.31.12:4597): protocol: rpc: dial tcp 77.90.31.12:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856929770 (355h47m50.783224447s) [noise=true , address=77.90.31.10:4533 , piece_id=2LLUWKNXQRH36SVXYML2FSKZXIZJL2R7L4EUOE6Q5FFPDCB56G2A, seg_pos={0 0}, upload=284963]: Done uploading piece. err: ecclient: upload failed (node:1RDgg3m5Febnz5CQKgkHvVYKBAzJG341rrT6pMchR1XxxEb7KS, address:77.90.31.10:4533): protocol: rpc: dial tcp 77.90.31.10:4533: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:59:23.856964646 (355h47m50.783259335s) [seg_pos={0 0}, upload=284963]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 8 04:59:23.881119663 (355h47m50.807414341s) [upload=284963]: Done uploading segments... Jul 8 04:59:23.881166367 (355h47m50.807461044s) [upload=284963]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.026067562s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.036408381s FAIL (2025-07-08 04:58:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== Jul 8 04:58:21.149027538 (355h46m48.075322225s) [upload=284962]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 8 04:58:21.149032924 (355h46m48.075327609s) [upload=284962]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 8 04:58:21.174948833 (355h46m48.101243542s) [seg_pos={0 0}, upload=284962]: Begin upload segment... Jul 8 04:58:21.175044289 (355h46m48.10133898s) [seg_pos={0 0}, upload=284962]: Done begin upload segment. Jul 8 04:58:21.175085645 (355h46m48.101380333s) [noise=true , address=45.91.116.8:4045 , piece_id=RSOQPUT5OWUIO2Q3TBC5JRJOP3FYQWFX3QA2XBWWU3L22TRYILDQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.175093954 (355h46m48.101388642s) [noise=true , address=104.36.82.6:4873 , piece_id=JP5EZ26GXBER73J43YSQGHQZYK4Z4XUKQNK2DY6MBEDY4V27ZMPA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.175626735 (355h46m48.101921426s) [noise=true , address=77.90.31.16:4733 , piece_id=32FGEFNEFZUO2I3D3PIRXQO4HGMOJVWMBJG6MCTPZLHDU2OTOPRQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.175667053 (355h46m48.101961748s) [noise=true , address=104.36.82.2:4729 , piece_id=SK2QQQNRIWIHDVPWHSWY3PEDN6VP3NF3BLFPM73646KJQWF23YWQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.175989826 (355h46m48.102284514s) [noise=true , address=77.90.31.18:4805 , piece_id=CCNMITZDKVNPR2GHZWPJ7P3NQXFTVSWMFZUXNPEW77YQ5WM3BBUA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.176089958 (355h46m48.102384658s) [noise=true , address=104.36.82.13:4186 , piece_id=CW4QOFWL5YC6GUWMRGPTZ36MILVII2AIWGJ3VUH7QEKQYR4JG7DQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.176469987 (355h46m48.102764681s) [noise=true , address=45.91.116.12:4226 , piece_id=OF2DHA23UDG7IJXGPZPPPE6YRKZWTOHMGRFCNL27L3N2V26DXNSQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.176490977 (355h46m48.10278568s) [noise=true , address=45.91.116.14:4190 , piece_id=3GV5AB232SW4WPCKE4HJUSNRLQTEUJKF6GNEQXU5SJDB25LGOLKA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.176875390 (355h46m48.10317008s) [noise=true , address=104.36.82.8:4970 , piece_id=2UC45MT4MA3TORMPQ25XQ6FP2GCCYZMHO2R2NJMRR7KN36GR3XZA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.176882807 (355h46m48.103177504s) [noise=true , address=104.36.82.7:4911 , piece_id=2MY7VZZKF7QDI4US7CTOJ4SA5AHNA5OO5ZFHOKLADYLDAKEWFDAA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.177857963 (355h46m48.104152662s) [noise=true , address=104.36.82.12:4149 , piece_id=2ZDDSMGD7RDYNVW3SR3TESZ2IHDPRYO6DUJTQNJRZSVDQ3V4N7IQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.178078652 (355h46m48.104373343s) [noise=true , address=77.90.31.10:4517 , piece_id=BWX2WUZFFQGKX5KDVPGX7P4NKP4GLVASGDCUQS56NER4ALX73OEA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.178413326 (355h46m48.104708025s) [noise=true , address=77.90.31.15:4698 , piece_id=DBDNLL5NOTH4YYX65H2G4QCRMV47C5Q5EC6SERK2GSALWZ6YP5QA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.179354555 (355h46m48.10564923s) [noise=true , address=45.91.116.14:4191 , piece_id=YOXV4RG3SLQCMZZKICWOUFEBJ4NEMTGZJV2644SUHXNLCIQXIGGQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.179888195 (355h46m48.106182886s) [noise=true , address=104.36.82.13:4185 , piece_id=EK7MN5OAMVONFS3LRMD2PG7UAJJOSV3J5XRJM447PJOYNEWGCBJA, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.185340322 (355h46m48.111634998s) [noise=true , address=45.91.116.14:4189 , piece_id=TPWB6ZDRGU7K5IXYHDR6CH6NSCVZUL5GBM3PEYUHU5P6ENOXJKQQ, seg_pos={0 0}, upload=284962]: Uploading piece... Jul 8 04:58:21.303735586 (355h46m48.230030273s) [upload=284962]: Next returned nil segment Jul 8 04:58:21.303753255 (355h46m48.230048003s) [upload=284962]: Waiting for error group managing segments... Jul 8 04:58:21.312310410 (355h46m48.238605085s) [noise=true , address=104.36.82.13:4186 , piece_id=CW4QOFWL5YC6GUWMRGPTZ36MILVII2AIWGJ3VUH7QEKQYR4JG7DQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:21.312396932 (355h46m48.238691632s) [noise=true , address=104.36.82.13:4185 , piece_id=EK7MN5OAMVONFS3LRMD2PG7UAJJOSV3J5XRJM447PJOYNEWGCBJA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:21.312988880 (355h46m48.239283552s) [noise=true , address=104.36.82.6:4873 , piece_id=JP5EZ26GXBER73J43YSQGHQZYK4Z4XUKQNK2DY6MBEDY4V27ZMPA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:21.313131297 (355h46m48.23942598s) [noise=true , address=104.36.82.8:4970 , piece_id=2UC45MT4MA3TORMPQ25XQ6FP2GCCYZMHO2R2NJMRR7KN36GR3XZA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:21.313499524 (355h46m48.239794197s) [noise=true , address=104.36.82.7:4911 , piece_id=2MY7VZZKF7QDI4US7CTOJ4SA5AHNA5OO5ZFHOKLADYLDAKEWFDAA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:21.313928790 (355h46m48.240223478s) [noise=true , address=104.36.82.2:4729 , piece_id=SK2QQQNRIWIHDVPWHSWY3PEDN6VP3NF3BLFPM73646KJQWF23YWQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:21.314013979 (355h46m48.240308666s) [noise=true , address=104.36.82.12:4149 , piece_id=2ZDDSMGD7RDYNVW3SR3TESZ2IHDPRYO6DUJTQNJRZSVDQ3V4N7IQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: <nil> Jul 8 04:58:51.112729100 (355h47m18.039023783s) [noise=true , address=77.90.31.10:4517 , piece_id=BWX2WUZFFQGKX5KDVPGX7P4NKP4GLVASGDCUQS56NER4ALX73OEA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 159.223.143.39:52670->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.112813244 (355h47m18.039107936s) [noise=true , address=45.91.116.14:4191 , piece_id=YOXV4RG3SLQCMZZKICWOUFEBJ4NEMTGZJV2644SUHXNLCIQXIGGQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.112877580 (355h47m18.039172265s) [noise=true , address=77.90.31.16:4733 , piece_id=32FGEFNEFZUO2I3D3PIRXQO4HGMOJVWMBJG6MCTPZLHDU2OTOPRQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.112941298 (355h47m18.039235975s) [noise=true , address=45.91.116.12:4226 , piece_id=OF2DHA23UDG7IJXGPZPPPE6YRKZWTOHMGRFCNL27L3N2V26DXNSQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.112993634 (355h47m18.039288311s) [noise=true , address=45.91.116.14:4190 , piece_id=3GV5AB232SW4WPCKE4HJUSNRLQTEUJKF6GNEQXU5SJDB25LGOLKA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 159.223.143.39:54274->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.113036132 (355h47m18.039330819s) [noise=true , address=45.91.116.14:4189 , piece_id=TPWB6ZDRGU7K5IXYHDR6CH6NSCVZUL5GBM3PEYUHU5P6ENOXJKQQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: rpc: dial tcp 45.91.116.14:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.113115601 (355h47m18.039410287s) [noise=true , address=45.91.116.8:4045 , piece_id=RSOQPUT5OWUIO2Q3TBC5JRJOP3FYQWFX3QA2XBWWU3L22TRYILDQ, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.113140903 (355h47m18.0394356s) [noise=true , address=77.90.31.15:4698 , piece_id=DBDNLL5NOTH4YYX65H2G4QCRMV47C5Q5EC6SERK2GSALWZ6YP5QA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.113215022 (355h47m18.039509715s) [noise=true , address=77.90.31.18:4805 , piece_id=CCNMITZDKVNPR2GHZWPJ7P3NQXFTVSWMFZUXNPEW77YQ5WM3BBUA, seg_pos={0 0}, upload=284962]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 159.223.143.39:57608->77.90.31.18:4805: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 04:58:51.113247323 (355h47m18.039542025s) [seg_pos={0 0}, upload=284962]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Jul 8 04:58:51.147552295 (355h47m18.073846972s) [upload=284962]: Done uploading segments... Jul 8 04:58:51.147582838 (355h47m18.073877515s) [upload=284962]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 30.036438157s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 535.162732ms FAIL (2025-07-08 02:04:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 535.19174ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 542.429486ms FAIL (2025-07-08 02:03:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 542.448749ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 682.58885ms FAIL (2025-07-08 02:02:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 682.617183ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 588.06542ms FAIL (2025-07-08 02:02:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 588.086029ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 511.129466ms FAIL (2025-07-08 02:01:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 511.162704ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 562.928172ms FAIL (2025-07-08 02:01:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 562.963668ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 908.244977ms FAIL (2025-07-08 02:00:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 908.275069ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 570.25202ms FAIL (2025-07-08 01:59:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 570.2776ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 692.432981ms FAIL (2025-07-08 01:58:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 692.527263ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 527.96985ms FAIL (2025-07-08 01:57:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 527.996908ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 525.624384ms FAIL (2025-07-08 01:56:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 525.860063ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 476.331507ms FAIL (2025-07-08 01:55:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 476.36354ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 632.204641ms FAIL (2025-07-08 01:55:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 632.931045ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 512.187607ms FAIL (2025-07-08 01:54:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 512.214538ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 537.775156ms FAIL (2025-07-08 01:53:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 537.809603ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 491.781197ms FAIL (2025-07-08 01:52:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 491.897935ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 502.011255ms FAIL (2025-07-08 01:51:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 502.049555ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 493.396901ms FAIL (2025-07-08 01:51:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 493.434159ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 567.661262ms FAIL (2025-07-08 01:50:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 567.70469ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 589.717528ms FAIL (2025-07-08 01:50:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 589.742876ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 457.405559ms FAIL (2025-07-08 01:49:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 457.462501ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 468.831429ms FAIL (2025-07-08 01:49:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 468.859959ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 507.940244ms FAIL (2025-07-08 01:48:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 507.995901ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 489.016891ms FAIL (2025-07-08 01:48:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 489.071002ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 479.125409ms FAIL (2025-07-08 01:47:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 479.150244ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 485.400783ms FAIL (2025-07-08 01:46:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 485.464823ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 483.033935ms FAIL (2025-07-08 01:45:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 483.058097ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 517.631825ms FAIL (2025-07-08 01:45:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 517.66142ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 481.560147ms FAIL (2025-07-08 01:44:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 481.63905ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 552.032141ms FAIL (2025-07-08 01:43:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 552.053349ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 528.594455ms FAIL (2025-07-08 01:42:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 528.617746ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 503.535303ms FAIL (2025-07-08 01:41:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 503.564249ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 637.564665ms FAIL (2025-07-08 01:40:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 637.587674ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 489.218752ms FAIL (2025-07-08 01:39:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 489.247775ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 504.714941ms FAIL (2025-07-08 01:38:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 504.736683ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 702.514471ms FAIL (2025-07-08 01:37:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 702.564144ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 473.166045ms FAIL (2025-07-08 01:36:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 473.180623ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 600.428796ms FAIL (2025-07-08 01:36:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 600.469162ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 465.537204ms FAIL (2025-07-08 01:35:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 465.590749ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 696.361119ms FAIL (2025-07-08 01:35:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 696.467135ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 484.290852ms FAIL (2025-07-08 01:33:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.319319ms edge gateway us-select-1

1
...
3113
3114
3115
3116
3117
...
3296