Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
967.670286ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/1b28667198f46193
FAIL (2026-01-27 23:50:45 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 967.697494ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
289.61281ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/1b28667198f46193
FAIL (2026-01-27 23:50:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 289.634934ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.741740786s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:56:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.741778595s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.091308921s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:55:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.091400231s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.507798593s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:54:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.507862167s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.08384857s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:52:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.083974839s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.50170172s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:52:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.501732799s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.037193523s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:50:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.037245399s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.507221612s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:49:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.507251423s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.502583876s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:48:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.502675589s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.445377123s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:48:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.445409588s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.074522828s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:48:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.074613573s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.06607821s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:47:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.066177775s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.10607572s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:46:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.106106184s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.08144833s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:45:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.081481222s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.503904314s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:44:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.50393506s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.459878573s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:44:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.459909775s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.443946543s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:43:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.443978189s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.496914337s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:42:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.496944794s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.023256255s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:41:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.023286199s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.013408331s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:40:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.013444577s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.542362656s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:40:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.542393834s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.056855644s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:38:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.056952315s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.513042813s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:38:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.513151331s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.489336287s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:37:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.489361452s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.458669073s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:37:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.45869116s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.061059181s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:37:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.061093986s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.464549726s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:36:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.464580726s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.053794922s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:35:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.053847769s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.509279128s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:34:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.509307759s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.11988417s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:34:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.119909524s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.488247732s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:33:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.488273833s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.089932901s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:32:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.089965655s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.226221285s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:32:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.226246595s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.201378409s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:30:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.201399745s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.053408616s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:29:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.053435204s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.490811902s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:29:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.490841765s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.489894976s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:28:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.489954868s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.49995238s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:28:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.500058899s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.077698449s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:27:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.077737954s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.053210395s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:27:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.053236236s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.036985588s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:26:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.037011256s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.528397295s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:25:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.52842876s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.490512311s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:24:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.490541281s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.091128904s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:23:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.091155623s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.527055768s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:22:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.52718239s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.052593801s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:22:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.052624736s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.049174493s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:22:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.049258721s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.069599689s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:21:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.069699279s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.045533876s trace:
https://jaeger.dev.storj.io/trace/76c3210128b3eed0
FAIL (2026-01-27 15:20:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.998063907 (287h16m52.481521104s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:58.999695726 (287h16m52.483152933s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.000648334 (287h16m52.484105538s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.001450719 (287h16m52.484907923s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002090038 (287h16m52.485547241s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.002421124 (287h16m52.485878312s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003043023 (287h16m52.486500221s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.003335587 (287h16m52.486792784s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.004133747 (287h16m52.48759095s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Uploading piece...
Jan 27 15:11:59.388610380 (287h16m52.872067577s) [upload=298668]: Next returned nil segment
Jan 27 15:11:59.388624989 (287h16m52.872082187s) [upload=298668]: Waiting for error group managing segments...
Jan 27 15:11:59.592079194 (287h16m53.075536384s) [noise=true , address=89.149.201.147:4016 , piece_id=ULONA3VZ3ZPTROA6JVBZEEVIK65U6DGGYMZYTKXQAAPCEJH2RSJA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.593077180 (287h16m53.076534381s) [noise=true , address=89.149.201.147:4011 , piece_id=M4LNFY3YWZD5GH3JSUOZXQVHTCH5M35VTUT42BXCNGP5RHWSWBBQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.595533944 (287h16m53.078991131s) [noise=true , address=185.167.204.205:4019 , piece_id=K6Z4I6D57L3XBYEHP5RURT3WE4Q636RQANYE4N7YSHGQY4UUJZ3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605231836 (287h16m53.088689034s) [noise=true , address=185.167.204.206:4067 , piece_id=FCPUYUGMWD6T7L7KLBVENUDRNCNYCQX3G6IPCDBALJIDZF4G42AA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.605440181 (287h16m53.088897388s) [noise=true , address=185.167.204.206:4063 , piece_id=SHP66ANXLSALHMEEHD4K7CI5A2SO26MMKMRZWTWKVL2BNO2NZUEA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.609108800 (287h16m53.092565997s) [noise=true , address=89.149.201.147:4021 , piece_id=Z422EUN45J3WLH45PRKP4EZQEJAD23HFKBFEPCG45IEZZT6VK67A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.612621456 (287h16m53.096078643s) [noise=true , address=81.171.14.70:4031 , piece_id=ITHFFMRLWQLMY7PLBUUEROBIRG2JFDMALAQX5FLHVITDNXVQ6O2A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.620364059 (287h16m53.103821269s) [noise=true , address=81.171.14.70:4026 , piece_id=6FVC7P5EUIPW5RMIIRKFMJW73BHY4F74SMHJAJUIW3PIS3XSRIFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.624204040 (287h16m53.107661228s) [noise=true , address=89.149.201.147:4020 , piece_id=VXF35ACW5645CFS5MSNKQLDJPLMWTUFYU723JMF7UVHYOQIATEDA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626489101 (287h16m53.109946301s) [noise=true , address=185.167.204.206:4055 , piece_id=CLCCTVRZQPIAED77WMNC65Q2KB7H7NFZWQ2HOYSLWK3XD3FES6DQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.626501357 (287h16m53.109958548s) [noise=true , address=81.171.14.70:4029 , piece_id=HWE63I55JRSA5YDKSKRYKPSYI3SMUJD2XBO3BMWR3FSAFNADWHHQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.632778260 (287h16m53.116235448s) [noise=true , address=185.167.204.206:4048 , piece_id=6FLPN5YSEC72SCVV5QWJLGY4NEOTU3Q4X7I7F2WEKHFGZWFM5KLQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.638904684 (287h16m53.12236189s) [noise=true , address=185.167.204.206:4054 , piece_id=OMQIQ4NMHDOHLALGQO5NKEOQGMMCTG63HFZJE3H2CYCF2HV5DOFQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639417934 (287h16m53.122875135s) [noise=true , address=81.171.14.70:4035 , piece_id=YJF76GEMQRZZ4JYAINNB5EUZYIGJRQHA3BVVK2BSJPMU4W3WVIHA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.639792544 (287h16m53.123249747s) [noise=true , address=81.171.14.70:4027 , piece_id=7JCL77P6DGY4FQR2WHCDNTCYXJX474AZOC3Q42BJSCMEVHXRBU6A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.640105629 (287h16m53.123562831s) [noise=true , address=89.149.201.147:4005 , piece_id=PIE7OZSTBNLGYVOML7LH6Q5ZKGBX3CURYWSWN3W4XWKI7R6BGNBA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.654423301 (287h16m53.137880499s) [noise=true , address=185.167.204.206:4068 , piece_id=526VJW7FQMKLPLML5QMSFO4JG2P7DXCHHAXTSGFODEPOV57BWZNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.662669228 (287h16m53.146126415s) [noise=true , address=185.167.204.206:4070 , piece_id=42XV3EO2MO32CT2YTQZCVDVHIOH3PBVWZ7TQ5R2UZPZJDFNOQJNA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.667207843 (287h16m53.150665046s) [noise=true , address=185.167.204.205:4009 , piece_id=6Z74NQT4O46HE2J62WSD55RO55WUNAQZIU3XUU45QXPXEUXCYYXQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.690120678 (287h16m53.173577866s) [noise=true , address=185.167.204.206:4071 , piece_id=NIO6IPSS4MGQXHCE2CB3IUYX6M2X35Q377WVMKPOMT6CVLR7VUZQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.710403261 (287h16m53.193860461s) [noise=true , address=185.167.204.205:4033 , piece_id=EJC5JINPA2AK5PRALFPGGCFHQVT7UQ7LDVQ3O7UBYYA6W5XUQWSA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:11:59.714374424 (287h16m53.197831631s) [noise=true , address=81.171.14.70:4033 , piece_id=ZYC3GYZGIVMYRP77QH2N6OVQL45QNULH4434YAN25Q354PAMM3LQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.069130062 (287h16m53.552587249s) [noise=true , address=89.149.201.147:4024 , piece_id=OK6YZMJO7I2M2QPS5GAOEN34ZHNXOXQIXQQPHWXEBXH5CUTK7ASA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.070567540 (287h16m53.554024727s) [noise=true , address=89.149.201.147:4019 , piece_id=VQKOG6MSQQTPCHBUMZAUGQSDXAC3ALDF53LYLGDDYRGSI2I5TZPA, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:00.093418989 (287h16m53.576876186s) [noise=true , address=81.171.14.70:4042 , piece_id=DWEE6HBW7C3MP4L5YB34H7DH4IO7T2CA2KTDD5PQLU4J3CX4EG7A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.240981414 (287h17m24.724438615s) [noise=true , address=185.167.204.205:4012 , piece_id=AIFBWTV62HUTVT536XKSRIRP3GMSSIOS5ODFE5TY3BJSJAQHTV3A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: <nil>
Jan 27 15:12:31.241016156 (287h17m24.72447334s) [seg_pos={0 0}, upload=298668]: Satisfied cohort requirements after 26 pieces
Jan 27 15:12:31.241375649 (287h17m24.724832857s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF
Jan 27 15:12:31.241403153 (287h17m24.72486036s) [noise=true , address=185.167.204.206:4041 , piece_id=DVNMYHEKUOC5KRBXEBOCPVS4DVOVXGKN55PI2I5PBOPODE5JCB5A, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241503291 (287h17m24.724960497s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: write tcp 159.223.143.39:48904->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 15:12:31.241513787 (287h17m24.724970993s) [noise=true , address=185.167.204.206:4056 , piece_id=XGB2CB33OKXNWVLUP73G57B3HSRUGU33FXWH46O6ANMEF443UBAQ, seg_pos={0 0}, upload=298668]: Long tail cancellation due to optimal threshold
Jan 27 15:12:31.241539848 (287h17m24.724997045s) [seg_pos={0 0}, upload=298668]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 27 15:12:31.241650389 (287h17m24.725107594s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 27 15:12:31.241655780 (287h17m24.725112981s) [upload=298668]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 27 15:12:31.401270124 (287h17m24.884727329s) [upload=298668]: Done uploading segments...
Jan 27 15:12:31.401312826 (287h17m24.884770025s) [upload=298668]: Upload finished. err: <nil>
Duration: 2.045571963s
core
uplink
eu-select-1
eu1-placement-15
|