Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 487.499313ms FAIL (2025-07-02 04:20:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 487.531108ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 499.621136ms FAIL (2025-07-02 04:20:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 499.654232ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 461.782876ms FAIL (2025-07-02 04:19:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 461.815984ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 496.879442ms FAIL (2025-07-02 04:18:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 496.916968ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 412.234602ms FAIL (2025-07-02 04:18:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 412.269803ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 466.822696ms FAIL (2025-07-02 04:17:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 466.852932ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 503.012566ms FAIL (2025-07-02 04:16:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 503.041986ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 433.352541ms FAIL (2025-07-02 04:15:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 433.382039ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 402.830402ms FAIL (2025-07-02 04:14:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 402.859376ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 430.617468ms FAIL (2025-07-02 04:14:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 430.656063ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.047507019s FAIL (2025-07-02 04:13:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== g segments... Jul 2 04:12:45.030542125 (211h1m11.95683682s) [upload=169061]: Upload finished. err: <nil> Jul 2 04:13:10.965456470 (211h1m37.891751147s) [upload=169066]: Starting upload Jul 2 04:13:10.965519651 (211h1m37.891814337s) [upload=169066]: Done starting upload Jul 2 04:13:10.965594008 (211h1m37.891888698s) [upload=169066]: Uploading segments... Jul 2 04:13:10.965864007 (211h1m37.892158689s) [upload=169066]: Got next segment. Inline: false Jul 2 04:13:10.965931585 (211h1m37.892226274s) [upload=169066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:10.965939958 (211h1m37.892234648s) [upload=169066]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:10.997048577 (211h1m37.923343267s) [seg_pos={0 0}, upload=169066]: Begin upload segment... Jul 2 04:13:10.997121527 (211h1m37.923416214s) [seg_pos={0 0}, upload=169066]: Done begin upload segment. Jul 2 04:13:10.997184914 (211h1m37.923479606s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.997810592 (211h1m37.924105286s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998393084 (211h1m37.924687779s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.998908968 (211h1m37.925203667s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999412859 (211h1m37.92570756s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:10.999914477 (211h1m37.926209177s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000290603 (211h1m37.926585304s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.000655808 (211h1m37.926950498s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001021435 (211h1m37.927316125s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001396683 (211h1m37.927691381s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.001768813 (211h1m37.928063509s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.002120882 (211h1m37.928415576s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.004711439 (211h1m37.931006136s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005173913 (211h1m37.931468603s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005511785 (211h1m37.931806486s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.005894444 (211h1m37.932189141s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Uploading piece... Jul 2 04:13:11.097809413 (211h1m38.024104092s) [upload=169066]: Next returned nil segment Jul 2 04:13:11.097838146 (211h1m38.024132833s) [upload=169066]: Waiting for error group managing segments... Jul 2 04:13:11.105922992 (211h1m38.03221767s) [noise=true , address=104.36.82.3:4767 , piece_id=NLIL5R65MFAYO5CUNSLG7IMNPXWXOUBT36TRUIHUXV36DUS4MXFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108705010 (211h1m38.034999699s) [noise=true , address=104.36.82.13:4187 , piece_id=72QGCOWMI7D2L4LVOWM3RORSII53M4X7MGQSWBFPGYXLLCACJVKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.108858761 (211h1m38.035153434s) [noise=true , address=104.36.82.16:4295 , piece_id=L2FOQOMWDGUHPDESXXOLGAV4MY23BWHB5IFNCU7FX3YN4P6DVKCQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109473130 (211h1m38.035767816s) [noise=true , address=104.36.82.10:4079 , piece_id=K4NVPDRNU5PXM2WG4FLKOP3N2BYZFWW5DG4R2MCD6WVC6R3EFXHA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.109628197 (211h1m38.035922885s) [noise=true , address=104.36.82.6:4873 , piece_id=RNXYJG6PDAUBAOHFM5VZQKUGW77NJ5V6EZFSXT2H2UFECWVVLWTA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110457373 (211h1m38.036752046s) [noise=true , address=104.36.82.2:4730 , piece_id=UNSXOZKX7OTQXKSP4XCGTTESGED4KMXI6AUJBRLWRRKSN5SCXUKA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.110564351 (211h1m38.036859028s) [noise=true , address=104.36.82.14:4222 , piece_id=TSOYJJTRJZLQU67W4QQC2JSXSC4OV6COLNC77F3ESJ3UFOYQXKNQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:11.477284670 (211h1m38.403579362s) [noise=true , address=104.36.82.5:4840 , piece_id=R525Z3BMZAVELJB44UFA7PAFBV7EXIIWP552ZDK4BEFYM6KBAXJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:30.909223722 (211h1m57.835518408s) [noise=true , address=77.90.31.10:4519 , piece_id=3YPNGRWQECLKPYC3BT6EJ5VZDPR2X74MR7JUZLQL7KLTZL2WDDMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:35.714396607 (211h2m2.640691285s) [noise=true , address=45.91.116.5:4299 , piece_id=OSWUV7SJB3OYM4EF5ZSJLQKDJYDONH773GDL7IKPKE4DSYHDC33Q, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:37.041001580 (211h2m3.967296254s) [noise=true , address=45.91.116.7:4011 , piece_id=AHVLPYLCKQLXIZQVMZUVX7N7BR7VHNQMD5REMZWP7XG3JBVWD5GQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: <nil> Jul 2 04:13:40.934871424 (211h2m7.861166118s) [noise=true , address=45.91.116.11:4119 , piece_id=OVPZUHLVUHQJOAOD6Y2WN5TXY25Y3GWMO4VI4XPPDHHIZNH5DUGA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:59848->45.91.116.11:4119: use of closed network connection Jul 2 04:13:40.934974084 (211h2m7.861268762s) [noise=true , address=77.90.31.16:4734 , piece_id=B7D3Q3X3W2ZM2FHAKPN5XPI4YSOSPDE2IRNGDS2XGA4MKSGXIKKQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:37322->77.90.31.16:4734: use of closed network connection Jul 2 04:13:40.935007706 (211h2m7.861302393s) [noise=true , address=45.91.116.5:4298 , piece_id=TBCQ6CV424U5P4YIS3BUSEYYOQBIZ6JVUUDVOT7XJIY5JFWGTSFQ, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50030->45.91.116.5:4298: use of closed network connection Jul 2 04:13:40.935083810 (211h2m7.861378487s) [noise=true , address=77.90.31.13:4627 , piece_id=6NFSWOQIZUNTA54T4Q6NU2P3OV3QVAYN323YU2GQ4PBGCVXDBOJA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 159.223.143.39:59326->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935152602 (211h2m7.861447292s) [noise=true , address=45.91.116.11:4118 , piece_id=WAXCI4KPRSZY4ETCCUTG3NOLBS2MIHZXU6VMRFBHWT4JE7R5DKMA, seg_pos={0 0}, upload=169066]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 159.223.143.39:50076->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.935211981 (211h2m7.861506668s) [seg_pos={0 0}, upload=169066]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:13:40.980211294 (211h2m7.906505972s) [upload=169066]: Done uploading segments... Jul 2 04:13:40.980234745 (211h2m7.90652942s) [upload=169066]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.047532741s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 513.933138ms FAIL (2025-07-02 03:36:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 513.975837ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 418.876083ms FAIL (2025-07-02 03:36:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 418.906763ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 501.461548ms FAIL (2025-07-02 03:35:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 501.488075ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 462.280006ms FAIL (2025-07-02 03:34:27 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 462.320975ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 442.986409ms FAIL (2025-07-02 03:33:50 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 443.015515ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 555.891968ms FAIL (2025-07-02 03:32:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 555.92209ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 516.647738ms FAIL (2025-07-02 03:31:34 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 516.676867ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 636.804586ms FAIL (2025-07-02 03:31:19 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 636.836811ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 571.072463ms FAIL (2025-07-02 03:30:39 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 571.101607ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 461.175221ms FAIL (2025-07-02 03:29:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 461.369058ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 617.853194ms FAIL (2025-07-02 03:28:38 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 617.924562ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 593.700436ms FAIL (2025-07-02 03:28:19 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 593.796344ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 463.836667ms FAIL (2025-07-02 03:27:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 463.860576ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 453.617382ms FAIL (2025-07-02 03:26:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 453.6445ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 550.690233ms FAIL (2025-07-02 03:25:12 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 550.726897ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 452.384869ms FAIL (2025-07-02 03:24:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 452.4228ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 537.196738ms FAIL (2025-07-02 03:22:54 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 537.227199ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 549.810105ms FAIL (2025-07-02 03:22:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 549.838928ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 443.562786ms FAIL (2025-07-02 03:21:13 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 443.593845ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 506.892489ms FAIL (2025-07-02 03:20:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 506.928448ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 760.778904ms FAIL (2025-07-02 03:20:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 760.816077ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 722.410266ms FAIL (2025-07-02 03:19:38 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 722.449878ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 449.431131ms FAIL (2025-07-02 03:18:36 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 449.459655ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 425.436072ms FAIL (2025-07-02 03:18:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 425.497732ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 491.818952ms FAIL (2025-07-02 03:17:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 491.937392ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 437.770335ms FAIL (2025-07-02 03:16:52 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 437.798275ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 633.851977ms FAIL (2025-07-02 03:15:45 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 633.87807ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 605.346564ms FAIL (2025-07-02 03:15:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 605.374636ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 507.169735ms FAIL (2025-07-02 03:13:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 507.200744ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 504.157036ms FAIL (2025-07-02 03:13:08 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 504.192098ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 594.19906ms FAIL (2025-07-02 03:12:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 594.243465ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 567.209622ms FAIL (2025-07-02 03:12:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 567.267316ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 481.799581ms FAIL (2025-07-02 03:11:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 481.826007ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 575.836373ms FAIL (2025-07-02 03:10:52 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 575.87314ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 585.57041ms FAIL (2025-07-02 03:09:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 585.599314ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 749.949935ms FAIL (2025-07-02 03:09:04 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 750.059823ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 552.30766ms FAIL (2025-07-02 03:08:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 552.720495ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 512.7168ms FAIL (2025-07-02 03:07:21 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 512.750378ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 549.815105ms FAIL (2025-07-02 03:07:04 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ece_id=4HWNWPU27EN6NDCHLIDTA7TR6SEDEGEEH374FY42E4S2YB64JIQA, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650643965 (209h38m42.57693864s) [noise=true , address=104.36.82.6:4873 , piece_id=U5UUFIN6D3CA65BQNOBGH2PXRXXUPJIHM4ICHMT2HGTNVYMYCQDQ, seg_pos={0 0}, upload=167939]: Done uploading piece. err: <nil> Jul 2 02:50:15.650681786 (209h38m42.576976485s) [seg_pos={0 0}, upload=167939]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 2 02:50:15.650762048 (209h38m42.577056758s) [upload=167939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:50:15.650767470 (209h38m42.577062168s) [upload=167939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:50:15.720813246 (209h38m42.647107948s) [upload=167939]: Done uploading segments... Jul 2 02:50:15.720854178 (209h38m42.647148871s) [upload=167939]: Upload finished. err: <nil> Jul 2 02:51:28.868670051 (209h39m55.79496473s) [upload=167956]: Starting upload Jul 2 02:51:28.868780851 (209h39m55.795075543s) [upload=167956]: Done starting upload Jul 2 02:51:28.868884538 (209h39m55.795179225s) [upload=167956]: Uploading segments... Jul 2 02:51:28.869381167 (209h39m55.795675855s) [upload=167956]: Got next segment. Inline: false Jul 2 02:51:28.869486445 (209h39m55.795781135s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 02:51:28.869493196 (209h39m55.795787888s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 02:51:28.898707948 (209h39m55.825002664s) [seg_pos={0 0}, upload=167956]: Begin upload segment... Jul 2 02:51:28.898787644 (209h39m55.825082342s) [seg_pos={0 0}, upload=167956]: Done begin upload segment. Jul 2 02:51:28.898825319 (209h39m55.825120018s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.898864369 (209h39m55.825159066s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899423277 (209h39m55.825717966s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899547497 (209h39m55.825842195s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.899793450 (209h39m55.82608814s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900152858 (209h39m55.826447544s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900210034 (209h39m55.826504727s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900634257 (209h39m55.826928949s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900678544 (209h39m55.826973233s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.900990193 (209h39m55.827284883s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901196315 (209h39m55.827491002s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901407463 (209h39m55.827702159s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901732148 (209h39m55.828026843s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.901817419 (209h39m55.828112106s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902270961 (209h39m55.828565648s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:28.902808316 (209h39m55.829103005s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Uploading piece... Jul 2 02:51:29.002833067 (209h39m55.929127747s) [upload=167956]: Next returned nil segment Jul 2 02:51:29.002849035 (209h39m55.929143729s) [upload=167956]: Waiting for error group managing segments... Jul 2 02:51:29.009136933 (209h39m55.935431621s) [noise=true , address=45.91.116.7:4011 , piece_id=OZPUOS5C2SXVMQ2UZO6GTOJGBNB44GP3FVDNEJ3TPV2S5AQQVKTA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.009959595 (209h39m55.936254298s) [noise=true , address=45.91.116.6:4973 , piece_id=J7CKQ2OY7GHL6AOAYQSFXV3OFGXFOXFECAX73DSMYN4I3BLWPLCQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.010805328 (209h39m55.937100001s) [noise=true , address=77.90.31.18:4807 , piece_id=SDJ5LDCGRMHFES4HBLA2YJHZBTBWCQUMZTJUKEAQCN6IV5EPS4RQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.011547112 (209h39m55.9378418s) [noise=true , address=77.90.31.19:4841 , piece_id=SPMT7Z5FJZEGSKMP2NRLVTQZYOWLRYHW2D3PUXNGBPUQEMSB5EXQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012145259 (209h39m55.938439932s) [noise=true , address=77.90.31.21:4879 , piece_id=XQJYDN6UJK4QH54DJRQQ4OC4AZXSKVOELEIWDKE4KVL2MXJSYQGA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.012854902 (209h39m55.939149581s) [noise=true , address=104.36.82.2:4732 , piece_id=R4KQGFFMSRGFAZCQIN3ABA4MBUKRVY7H6X7VLD7FDSUACSTEB3JA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013365184 (209h39m55.939659859s) [noise=true , address=104.36.82.16:4295 , piece_id=MDKAEJ6U4QKMYWVLISRRT4YCJDKCLDYM6UIW4NYAOAJC5C3HZYBA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.013906104 (209h39m55.940200783s) [noise=true , address=45.91.116.14:4189 , piece_id=W6QMHY4YNWVGK7JGDRNW4R2XHOLOA36LHEGE2572ECQXUS54SBLQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.014907872 (209h39m55.941202559s) [noise=true , address=104.36.82.4:4801 , piece_id=VKANDMNYUM2TWXEJIMVBP4VCUDQHMJUCKVXBDT2Y5HKWZH7RM6AA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015448646 (209h39m55.941743332s) [noise=true , address=104.36.82.16:4293 , piece_id=KQLDNUQZQNJANZLTPHSGBUROZQIUG6B3F46BH6SXXJYMRZ7JUIDQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015581494 (209h39m55.941876167s) [noise=true , address=104.36.82.11:4115 , piece_id=UZYHXFCH5RBH66TE7L7BB7JO4WTF2JMQQWOYQDANBF5WLNKHQWPQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.015893548 (209h39m55.942188225s) [noise=true , address=104.36.82.3:4767 , piece_id=SMXUO4BJEZGF6CNWUBR3COHII766QREWKBSBHZV36XAE6OKREIUQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017028456 (209h39m55.943323135s) [noise=true , address=104.36.82.12:4151 , piece_id=LDQKELV6DGYKJKK24FV7Y463CDUV37ODLSXXCYUDUXG3M372LGCA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: <nil> Jul 2 02:51:29.017043139 (209h39m55.943337815s) [seg_pos={0 0}, upload=167956]: Segment reached optimal threshold of 13 pieces. Jul 2 02:51:29.017178229 (209h39m55.943472905s) [noise=true , address=104.36.82.6:4874 , piece_id=Y2OV6DP3QYECFBZU2R2OHY5NAILXKQC2AD2F2PWTIMX63XSVBKFQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017310273 (209h39m55.94360495s) [noise=true , address=104.36.82.10:4078 , piece_id=K4U2MB7WNX62IPDYMSVTL2MCUBC6HHRH56Y2IFDJJ6SSNZO6ODNA, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017394571 (209h39m55.943689253s) [noise=true , address=104.36.82.13:4185 , piece_id=Q4J5PORHO4R3RSWFSCSZEFFT3BXFGBDOLT2S3ENFEV5PTEP5JUIQ, seg_pos={0 0}, upload=167956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: expected piece hash; context canceled; EOF Jul 2 02:51:29.017409321 (209h39m55.943704012s) [seg_pos={0 0}, upload=167956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 02:51:29.017486214 (209h39m55.943780908s) [upload=167956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 02:51:29.017491827 (209h39m55.943786629s) [upload=167956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 02:53:50.138713219 (209h42m17.065007921s) [upload=167956]: Done uploading segments... Jul 2 02:53:50.138739023 (209h42m17.065033711s) [upload=167956]: Upload finished. err: metaclient: context deadline exceeded Duration: 549.841021ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)