Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.496914337s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:42:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.496944794s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.023256255s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:41:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.023286199s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.013408331s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:40:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.013444577s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.542362656s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:40:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.542393834s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.056855644s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:38:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.056952315s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.513042813s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:38:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.513151331s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.489336287s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:37:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.489361452s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.458669073s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:37:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.45869116s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.061059181s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:37:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.061093986s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.464549726s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:36:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.464580726s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.053794922s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:35:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.053847769s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.509279128s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:34:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.509307759s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.11988417s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:34:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.119909524s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.488247732s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:33:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.488273833s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.089932901s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:32:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.089965655s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.226221285s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:32:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.226246595s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.201378409s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:30:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.201399745s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.053408616s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:29:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.053435204s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.490811902s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:29:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.490841765s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.489894976s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:28:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.489954868s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.49995238s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:28:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.500058899s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.077698449s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:27:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.077737954s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.053210395s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:27:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.053236236s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.036985588s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:26:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.037011256s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.528397295s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:25:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.52842876s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.490512311s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:24:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.490541281s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.091128904s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:23:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.091155623s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.527055768s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:22:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.52718239s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.052593801s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:22:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.052624736s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.049174493s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:22:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.049258721s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.069599689s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:21:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.069699279s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.045533876s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:20:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.045571963s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.451323402s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:19:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.451420797s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.021703218s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:19:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.021747221s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.488523248s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:18:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.488560905s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.995781966s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:18:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 1.995812684s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.098623281s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:17:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.098641072s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.446131446s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:17:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.446157797s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.052511147s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:16:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.052540121s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.034708808s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:15:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.034737275s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.088897057s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:15:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.088929491s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.47999855s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:14:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.480076511s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.403674622s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:13:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.403695822s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.005271839s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:12:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 1m0.005294135s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
467.130206ms trace:
https://jaeger.dev.storj.io/trace/32caaa369a21039
FAIL (2026-01-27 05:57:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 467.492103ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
451.440844ms trace:
https://jaeger.dev.storj.io/trace/32caaa369a21039
FAIL (2026-01-27 05:56:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 451.478265ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
458.618302ms trace:
https://jaeger.dev.storj.io/trace/32caaa369a21039
FAIL (2026-01-27 05:56:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 458.64129ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
417.734829ms trace:
https://jaeger.dev.storj.io/trace/32caaa369a21039
FAIL (2026-01-27 05:55:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 417.813581ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
427.466089ms trace:
https://jaeger.dev.storj.io/trace/32caaa369a21039
FAIL (2026-01-27 05:55:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 427.525366ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
464.307036ms trace:
https://jaeger.dev.storj.io/trace/32caaa369a21039
FAIL (2026-01-27 05:54:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 464.33712ms
edge
gateway
us-select-1
|